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ABSTRACT 


Technologies for automated detection and recording of insect behavior and move- 
ments have evolved dramatically in the past decade. Because the flight activity of 
honey bees provides crucial information on their health conditions and a rough esti- 
mate of the state of the hive, tracking and recording the displacements of bees with 
automatic devices are of primary interest. This also allows us to better understand 
their mechanisms of orientation, their capacity to exploit their environment, and to 
better estimate the adverse effects of chemicals voluntarily or accidentally spilled in 
the aquatic and terrestrial ecosystems. In this context, an attempt is made to review 
all automatic systems that can be used to track honey bees. The problems linked to 
the analysis of recorded data are also discussed. 
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11 INTRODUCTION 


It is widely appreciated that honey bee activity plays a key role in the agricultural 
economy worldwide. In addition to the production of honey, pollen, wax, propolis, 
and royal jelly, the honey bee constitutes an important, sometimes unique, pollina- 
tor of numerous crops [1-5], even if this bee—crop dependence has to be related to 
the evolution of agricultural practices in different countries [6]. The honey bee also 
plays an important functional role in most terrestrial ecosystems for maintaining the 
biodiversity of wild-plant communities [7—9]. 

Unfortunately, the continual expansion of industrial production and the growing 
use of pesticides in agriculture have led to an increase in the number and quantities 
of xenobiotics released into the environment. Thus, the amount of pesticides used 
worldwide was approximately 5.2 billion pounds both in 2006 and 2007, with the 
United States being the leader in development, production, and sales. Indeed, the 
United States accounted for 22% of the quantity used worldwide and 25%, 10%, 
and 1446 of the amount of herbicide, insecticide, and fungicide used worldwide, 
respectively [10]. Analysis of US Customs Service shipping records for 2001-2003 
also reveals that about 1.7 billion pounds of pesticides were exported from US 
ports at a rate of more than 32 tons/h. This includes nearly 28 million pounds of 
pesticides whose use is banned in the United States [11]. Between 2001 and 2003, 
more than 125 million pounds of pesticides were exported, which have been identi- 
fied as highly toxic to bees. This represents a yearly average of 42 million pounds, 
or 2 tons/h. Exports of dimethoate accounted for about 65% of the 2001-2003 
total [11]. Europe is also a major consumer of pesticides. In 2003, 219,771 tons of 
pesticides were used in the 25 countries of the European Union, including 107,574 
tons of fungicides, 83,934 tons of herbicides, 21,404 tons of insecticides, and 6,859 
tons of growth regulators. Five countries together accounted for nearly 7596 of the 
total used in EU-25. France alone accounted for 2896, Spain and Italy 1446 each, 
Germany 11%, and the United Kingdom 7% [12]. The situation is not much differ- 
ent as regards industrial chemicals. Thus, for example, the European Inventory of 
Existing Commercial Chemical Substances (EINECS) includes more than 100,000 
substances that were deemed to be on the European Community market between 
1971 and 1981 [13]. The potential adverse effects of these substances are often 
unknown, whereas they can contaminate the environment [14]. 

Foraging bees are directly affected by all these pollutants spilled voluntarily 
or accidentally into the environment. Depending on the chemical nature of the 
pollutants and the dose absorbed, foragers can die in the field, on the flight back to 
the hive, at the hive entrance, or a little later. Foragers can also contaminate hive 
inhabitants with poisoned nectar, pollen, and water brought back to the hive. It is 
well known that an acute poisoning event by pesticides or other chemicals is often 
detected by the presence of a large number of dead or dying bees at the hive entrance. 
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Unfortunately, sublethal effects are not detected so easily. Consequently, there is a 
need to evaluate the activity of the foragers for detecting abnormal behaviors. 

Insect marking for scientific studies dates back to the beginning of the twentieth 
century, and all the methods in use have been comprehensively reviewed by Hagler 
and Jackson [15]. In this context, the aim of this chapter is to review automatic 
devices that allow us to evaluate normal and abnormal behaviors of foraging bees. 
Broadly speaking, there are systems that capture the overall activity of bees and 
those able to track them individually during their flight. Instead of cataloging the 
studies using these different systems, an attempt is made to stress their importance 
in ecotoxicology and ecology as well as their requirements in terms of data manage- 
ment, cleaning, and analysis. 


1.2 MONITORING THE OVERALL ACTIVITY OF ADULT BEES 


1.2.1 PHOTOELECTRIC SYSTEMS 


When no significant mortality is observed in close proximity to the hive after insec- 
ticide treatment, it may be appropriate to quantify the bee in-and-out activity at the 
hive entrance for a few weeks in order to detect potential losses due to sublethal 
effects. Quantifying bee loss is also useful as a regular beekeeping practice for fol- 
lowing hive activity. Several attempts have been made to design automatic counter 
devices for outgoing and incoming honey bees. The first prototypes were based on 
the recording of electrical impulses [16,17] or on the use of photoelectric signals [18]. 
Another system was designed by Chauvin [19,20] based on a mechanical setup that 
distinguished between outgoing and incoming flights, which was easily adapted to 
Dadant hives. Different initiatives have progressively improved the functioning and 
capacities of the photoelectric cell systems [21-30]. With time, the number of bees 
detected increased, the direction of bee movements was better discriminated, and 
the capacity of storage increased. The devices were more robust and adapted to out- 
door conditions. Therefore, they were adequate for carrying out semifield or field 
trials to follow the daily activity of the colonies and detect bee losses due to preda- 
tors, pathogens, or poisoning. The most interesting system currently commercial- 
ized is the BeeScan™ counter supplied by Lowland Electronics BVBA (Belgium). 
A basic description of this counter was published by Struye et al. [31]. More recent 
technical information can be obtained in the instruction manual [32]. Briefly, bee 
movement detection at the hive entrance is made through 32 bidirectional channels. 
The detection of a bee inside a channel is performed via an infrared diode exciting 
two photoreceptors. The counter is able to detect a distance of 1 mm between bees, 
which reduces the chance of miscounting them as they move head to tail through a 
channel. The counting period can be of 1, 5, 10, 15, 30, or 60 min. For the selected 
period, the “in,” “out,” and “out-in” (i.e., difference between out and in) data and the 
corresponding cumulative values (i.e., “IN,” “OUT,” and “OUT-IN”) are recorded 
and stored. The memory can store 61 files, each corresponding to 24 h of recording. 
A BeeScan counter can be used between 0°C and 55°C and with a relative humidity 
of 0%-100% [32]. It is suited to study the nycthemeral activity of adult bees dur- 
ing the recorded time. Thus, for example, Figure 1.1a shows bee activity at the hive 
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FIGURE 1.1 Nycthemeral activity of adult bees in (a) Montpellier and (b) Martinique 
recorded from a BeeScan counter. 
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entrance each hour of the day in July during an experiment performed in Montpellier 
(France), which has a Mediterranean climate. Bee activity began significantly around 
8 a.m., then increased regularly until the beginning of the afternoon, followed by a 
decrease with a small peak at the end of the afternoon. In this hive, the activity during 
the evening and at night was near null. Figure 1.1b also shows the movements at the 
hive entrance during a cycle of 24 h, but the experiment was performed in Martinique 
Island (French Indies), which has a tropical climate. It was anticipated that the activ- 
ity started and ended early, but more surprising was the discovery that the activity 
rapidly increased to reach a maximum and then a kind of plateau appeared till noon. 
Then an increase of activity was observed till a maximum around 3 p.m., followed by 
a quick decrease with very limited activity from 7 p.m. to 4 a.m. It is noteworthy that 
the nycthemeral activities shown in Figure 1.1 correspond to two hives, but during 
the two experiments, other hives, were equipped with BeeScan counters and showed 
similar patterns. From a practical point of view, knowledge of the nycthemeral cycle 
of bees in relation to local climatic characteristics allows us to select an optimal time 
to apply insecticide treatment in agriculture or in vector control. Obviously, this will 
be done when a minimum number of bees are outside the hive. 

BeeScan counters are also particularly suited to study the influence of abiotic 
factors on bee activity. Thus, Figure 1.2 shows the daily activity of a hive from 
February 17 to March 11, 2012. There were strong rains on March 3, and as a 
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FIGURE1.2 Example of daily activity recorded from a BeeScan counter. 
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result, bee activity was very limited. Obviously, this rather trivial example is only 
for illustration. To study the specific influence of the different abiotic factors on 
bee activity, it is necessary to take advantage of the numerous possibilities offered 
by the multivariate statistical analyses [33]. Devillers et al. [34] studied the influ- 
ence of various abiotic factors on the daily activity of bees. Six hives equipped 
with BeeScan counters (BA-BF) and three hives with pollen traps (PI—P3) were 
installed near sunflower fields (Helianthus annuus L., cultivar prodisol) treated 
at the seed stage with Aventis Regent TS (500 g/L of fipronil) and located in the 
agricultural district of Birieux (France). Counter data were collected during 53 con- 
secutive days from about mid-July to the beginning of September. Because the 
climatic data were only measured hourly, bee-counter data were converted to the 
same timescale. Queens in two hives equipped with counters were changed dur- 
ing the experiments. Consequently, these were excluded. This allowed us to design 
53 dx24 h data matrices of activity for three different hives and a 50 d x24 h data 
matrix for the fourth hive because the data were not recorded for three consecutive 
days. Double paired data matrices with different climatic data were also designed. 
To pinpoint the relative importance of each abiotic factor on bee activity, co-inertia 
analysis (CIA) [35,36] was used. Briefly, CIA can be viewed as a generic multivariate 
approach used to find a costructure between two data tables (Figure 1.3). These two 
data matrices are first considered independently. They can be analyzed by means 
of different multivariate approaches such as principal components analysis (PCA) 
[37], correspondence factor analysis, or multiple correspondence factor analysis 
[38], depending on the nature of the data. These separate analyses emphasize the 
basic structure of the counter data matrix and the abiotic data matrices. Thus, for 
example, Figure 1.4 shows the PCA of the counter data obtained with the BB hive. 
The PC,PC, map accounts for 79% of the total inertia of the system. Trajectories 
between objects (Figure 1.4a) and between variables (Figure 1.4b) were drawn to 
facilitate the interpretation of the two corresponding spaces. Figure 1.4a reveals 
three main clusters broadly related to the different months of the experiments. Data 
recorded in July are located in the right part of Figure 1.4a. The middle part is 
mostly occupied by the data recorded in August, while the left part deals with data 
collected at the end of August and at the beginning of September. These clusters 
correspond to a decreasing gradient of flying activity from right to left of Figure 
1.4a. For example, the total number of outgoing bees on July 20 was 207,314 (point 
#9) while that recorded on September 4 was only 55,723 (point #53). Interestingly, 
some points in Figure 1.4a do not follow these rules. Thus, for example, point #4 
(July 15) and point #7 (July 18) have an atypical location in PC,PC,. This was due 
to weather disturbances. Indeed, July 15 was cloudy and windy and July 18 was 
as rainy as August 19 (point #37). Figure 1.4b displays the classical nycthemeral 
activity of honey bees. However, PCA allows us to extract less obvious informa- 
tion on the flying behavior of bees. Indeed, the particular shape of the trajectory 
in Figure 1.4b is due to the fact that in the first part of July, the bees left the hive 
very early in the morning and stopped their gathering activity only in the evening. 
Conversely, in the beginning of September, they only worked significantly around 
10 a.m. and, in addition, stopped fairly early in the afternoon. This pattern is graph- 
ically illustrated in Figure 1.4a for points 9 (right) and 53 (left), where the greater 
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FIGURE 1.3 General principle of CIA. (From Comput. Electron. Agric. J., 42, Devillers, J., 
Doré, J.C., Tisseur, M., Cluzeau, S., and Maurin, G., Modelling the flight activity of Apis 
mellifera at the hive entrance, 87-109, Copyright [2004], with permission from Elsevier.) 


the length of a clockwise line, the higher the number of outgoing bees. The cor- 
responding time is also represented. Similarly, a PCA was performed on each data 
matrix of abiotic factor (results not shown). In the second step of the CIA (Figure 
1.3), a matching analysis is performed in order to detect a costructure between the 
two data matrices. This second analysis is based on the search of co-inertia axes, 
maximizing the covariance between the coordinates of the projections of the rows 
of each data table. Figure 1.5 summarizes the results obtained with CIA of the 
counter data of the BB matrix x temperature data matrix. A detailed analysis of this 
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FIGURE 1.4 Pattern resulting from the PCA of the bee-counter data recorded at BB hive 
entrance. (a) Days, (b) hours, and (c) histogram of the eigenvalues. (From Comput. Electron. 
Agric. J., 42, Devillers, J., Doré, J.C., Tisseur, M., Cluzeau, S., and Maurin, G., Modelling 
the flight activity of Apis mellifera at the hive entrance, 87-109, Copyright [2004], with 
permission from Elsevier.) 
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FIGURE 1.5 CIA between the bee counter of the BB hive and temperature data matrices. 
Projection of the axes resulting from each separate analysis on co-inertia axes for (a) the 
bee-counter data matrix and (b) the temperature data matrix. Projection of the 53 plots by 
24 components array via CIA for bee-counter data matrix (c and d) and temperature data 
matrix (e and f). (g) Result of the permutation test. (h) Matching graph. (From Comput. 
Electron. Agric. J., 42, Devillers, J., Doré, J.C., Tisseur, M., Cluzeau, S., and Maurin, G., 
Modelling the flight activity of Apis mellifera at the hive entrance, 87-109, Copyright [2004], 
with permission from Elsevier.) 
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figure is beyond the scope of this chapter and can be found in Devillers et al. [34]. 
Of prime importance is Figure 1.5g, which displays the results of a permutation 
test based on Monte Carlo simulations during which 1,000 CIAs using matrices 
with random permutations were performed. It shows that there exists a costructure 
between the two data matrices. Figure 1.5h shows the simultaneous graphical dis- 
play obtained at the end of the matching process of CIA (Figure 1.3, bottom). The 
identification numbers 1—53, in small circles, stand for the different days of experi- 
ment and the length of the arrows visualizes the degree of costructure between the 
two matrices under study (i.e., bee activity/temperature). The lower the length of the 
arrows, the higher the costructure between the two matrices. The lengthy arrows in 
Figure 1.5h can be easily explained. Thus, for example, when it rained, especially 
in July and for a short period of time, the temperature did not significantly decrease 
but the bee activity outside the hive ceased. Nevertheless, Figure 1.5h clearly shows 
that a strong costructure exists between the two data tables. It is noteworthy that 
Devillers et al. [34] used BeeScan counter data to derive quantitative models from 
the abiotic data by using partial least squares (PLS) analysis [39] and a three-layer 
perceptron [40]. 

Decourtye et al. [41] compared the sublethal effects of imidacloprid (24 g/kg) 
and deltamethrin (500 pg/kg) on bees in both semifield and laboratory conditions. 
The main goal of the study was to compare the results obtained with restrained 
worker bees in the conditioned proboscis extension response (PER) laboratory 
assay [42] with those recorded by using free-flying foragers visiting an artificial 
flower feeder in an outdoor flight cage and undergoing an olfactory conditioning 
procedure. A BeeScan counter was used to measure the activity at the hive entrance. 
After feeding with sucrose solution contaminated with imidacloprid at the concen- 
tration of 24 ug/kg, negative effects on the learning performances were observed 
in foraging bees subjected to both olfactory conditioning procedures. In addition, 
the neonicotinoid insecticide induced a reduction of activity at the hive entrance. 
Conversely, deltamethrin 500 ug/kg did not impact the learning performance of 
bees. In addition, although a clear reduction of forager visits on the artificial flower 
feeder was observed, no changes in activity at the hive entrance were noted during 
the delivery of a food solution added with deltamethrin [41]. Recently, BeeScan 
counters were also used to assess the potential impact of vector control treatments 
with deltamethrin on honey bee colonies in Martinique [43]. 


1.2.2 VIDEO MONITORING 


The use of video to study bee activity within and outside the hive is relatively 
recent. This relies on the availability, at affordable cost, of digital cameras and 
high-performance computing devices. Video has found applications in the analysis 
of bee movements within the hive, especially dances [44]. Bees perform two types of 
dances for communicating the location of food sites. When the site is within a radius 
of about 50 m from the colony, the bee performs a round dance, which consists of 
a series of alternating left-hand and right-hand loops. When the site is considerably 
far from the nest (2100 m), the bee performs the so-called waggle dance. In this 
dance, the transition between one loop and the next is punctuated by a phase during 
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which the bee waggles her abdomen from side to side while moving in a more-or-less 
straight line. Thus, the bee executes a left-hand loop, performs a waggle, executes a 
right-hand loop, performs a waggle, executes a left-hand loop, and so on. During the 
waggle phase, the abdomen moves from side to side at an approximate frequency of 
12-15 Hz. The longer the duration of the waggle phase, the greater the distance of 
the food source. Information about the direction of the food source and its attractive- 
ness is also conveyed in the waggle dance [45—48]. 

Experimenters can manually study the videos of bee dances and annotate the 
various sequences of motions. Although the task is simple and does not require 
specific expertise, it is time consuming, tiring, and prone to errors. Recently, efforts 
into automating such tasks became evident with the advances made in vision-based 
tracking systems. Feldman and Balch [49] proposed a system to automatically ana- 
lyze bee movements, and label it, on the basis of examples. First, a video cam- 
era records bees in the observation hive. This video is passed to a tracker, which 
extracts coordinate information to be used by the human labeler (creating the train- 
ing set) and then by the k-nearest neighbor (KNN) classifier. KNN is a good clus- 
tering method, but it cannot account for time series information. To overcome this 
problem, a hidden Markov model (HMM) was used. Once the HMM was speci- 
fied, the Viterbi algorithm was used to determine the most likely state sequence 
for a given observation sequence. Their system was able to label movements with 
81.596 accuracy in a fraction of the time it would take a human [49]. Veeraraghavan 
et al. [48] proposed general principles that could help in simultaneous automatic 
tracking and behavior analysis with applications in tracking bees and recognizing 
specific behaviors exhibited by them. They suggested a joint tracking and behavior 
analysis instead of the traditional track and then recognize approach for activity 
analysis. They proposed the use of hierarchical Markov models to simulate vari- 
ous behaviors and presented methods for detecting and characterizing abnormal 
behaviors. They showed how it was possible to simultaneously track and analyze 
bee dances in their hive [48]. Campbell et al. [50] used a video camera positioned 
over the unmodified entrance of a standard hive for measuring the flight activity of 
bees. They distinguished four different behaviors, namely, loitering, crawling, flying 
out, and flying in, which were modeled. The task of tracking bees was treated from 
frame-to-frame as an assignment problem and solved using maximum weighted 
bipartite graph matching. The training dataset for the motion models consisted of 
600 frames annotated with the motion type and frame-to-frame change in position 
and orientation of every visible bee. They annotated 1,800 additional frames with 
ground truth of arrivals, departures, and number of visible bees in each frame. The 
counter was able to detect bees with a precision of 94%. It overcounted arrival by 
2% and undercounted departures by 7% on the annotated data set [50]. Chen et al. 
[51] fixed a charge-coupled device (CCD) camera capable of sensing infrared light at 
the entrance of a hive for monitoring the in-and-out activity of honey bees. Through 
the stable light provided by an infrared LED, the camera was able to acquire images 
with consistent light intensity and send them to the computer via a USB interface. 
The computer was also used to identify the tags on the backs of the bees and record 
the conditions of the entries to and exits from the hive. Tag identification was made 
from a model derived from a support vector machine [52]. The system was tested on 
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100 tagged bees during 15 days. The size of the colony was about 12,000 honey bees. 
On the first day, 82 honey bees were detected. On the second day, 59 honey bees 
were detected, which is a 31% reduction. Similarly, 40 honey bees were detected 
on the third day, which represents a 32% reduction [51]. Colin et al. [53] used a 
video camera to quantify the foraging activity of small colonies of bees confined in 
two semicylindrical insect-proof tunnels after a contamination by the neonicotinoid 
insecticide imidacloprid at 6 pg/kg or by the phenylpyrazole insecticide fipronil at 
2 ug/kg. Contaminations were made via sucrose solutions filling a feeder. A con- 
trol sugar solution was offered to all the colonies on the first day (day 0). During 
the four consecutive days, a contaminated sugar solution was given to three nuclei, 
while the other remained with a noncontaminated solution. The number of bees on 
the feeder was counted every 3 min using data from the video film. Bees sucking 
the sucrose solution were considered as active and the others as inactive. The first 
criterion selected by the authors [53] was the number of active bees relative to time 
and was called attendance. The second criterion was the ratio of number of inactive 
(I) to active (A) bees. Colin et al. [53] showed that imidacloprid at 6 pg/kg did not 
affect attendance, but a significant increase in the I/A ratio on day 4 was observed. 
Fipronil at 2 ug/kg showed a strong effect on bee attendance and also induced a 
drastic decrease in the number of foragers coupled with an increase in the number 
of inactive bees at the feeder [53]. 


1.3 MONITORING THE ACTIVITY OF INDIVIDUAL BEES 


1.3.1 Use or RADIOFREQUENCY IDENTIFICATION 


Radiofrequency identification (RFID) systems are noncontact identification devices 
now commonly used in numerous domains, including the study of insect behaviors 
[54]. Indeed, tracking the movements of insects in their natural habitat is essential to 
understand their biology, ethology, and behavior when faced with pollutants. RFID 
systems consist of two components, which are the transponder or tag, attached to 
the object that needs to be identified, and the reader, used to detect the information 
stored on the transponder. Figure 1.6 shows a bee with a transponder glued to the 
back side of her thorax in such a way that the movements of the wings cannot be 
hampered. Decourtye et al. [55] developed a method under tunnel to automatically 
record the displacements of foragers individualized with RFID tags and to detect 
the alteration of the flight pattern between an artificial feeder and the hive after con- 
tamination with fipronil. RFID tags (mic39-TAG 64-bit RO, iID2000, 13.56 MHz 
system, 1.0 mmx 1.6 mmx0.5 mm; Microsensys GmbH, Erfurt, Germany) weigh- 
ing about 3 mg were used. This represents about 396 of the weight of a bee and is 
considerably low, especially if we consider that she is able to carry up to 70 mg of 
nectar [56] and 10 mg of pollen [57]. Five readers were placed at the entrance of 
the hive and artificial feeder. A software called BeeReader (Tag Tracing Solution, 
Valence, France) recorded the identification codes and the exact time of the events 
in files having a .txt format. Data cleaning and analysis were made with TimeBee® 
(CTIS, Rillieux-La-Pape, France). Technical grade fipronil (98% pure) was tested 
at sublethal doses of 0.06 and 0.3 ng/bee. Stock solutions were prepared in ethanol. 
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FIGURE 1.6 (See color insert.) Bee with an RFID tag glued to the back side of her thorax. 
(Reproduced with kind permission of Axel Decourtye, ACTA.) 


Fipronil was added to a sucrose solution (5096 w/w). The final concentration of eth- 
anol in the sucrose solution was 196 (v/v). After a 3 h starvation period, each group 
of tagged foragers received a volume of contaminated or control sugar solution. 
Decourtye et al. [55] showed that the percentage of disappearing bees between the 
feeder and the hive was similar for all treatments. For the overall period, the per- 
centage of bees not returning to the hive was between 24% and 44%. Conversely, 
fipronil at the dose of 0.3 ng/bee induced an increase in the flight time between 
the artificial feeder and the hive in comparison to the control group and the group 
treated with 0.06 ng/bee. Bees treated with 0.3 ng/bee showed the lowest number 
of foraging trips within the first 24 h, but after this period, the number of trips was 
not different from that of the other groups. The next step was to use the RFID sys- 
tems under field conditions. This was done by Henry et al. [58] in a study on thia- 
methoxam, a recently marketed neonicotinoid systemic insecticide currently used 
to protect oilseed rape, maize, and other blooming crops foraged by honey bees. 
These authors proceeded in two steps. First, they assessed mortality induced by 
homing failure (m,;) in exposed foragers. The study was conducted in an intensive 
cereal farming system of western France and in a suburban area in Avignon, south- 
ern France. To simulate daily intoxication events, foragers received a sublethal dose 
of 1.34 ng of thiamethoxam in a 20 mL sucrose solution and were released away 
from their colony with an RFID tag glued on each bee's thorax. In a second step, 
they assessed the extent to which m,,, in combination with natural forager mortal- 
ity, might upset colony dynamics. For that purpose, m,r was introduced into a model 
of honey bee population dynamics [59]. Henry et al. [58] revealed that exposure of 
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foragers to nonlethal but commonly found doses of thiamethoxam could affect for- 
ager survival, with potential contributions to collapse risk. Furthermore, the extent 
to which exposures affected forager survival seemed to be dependent on the land- 
scape context and the prior knowledge of foragers about this landscape. Higher risks 
were observed when the homing task was more challenging [59]. Schneider et al. 
[60] also used RFID tags to study the potential effects of two other neonicotinoid 
insecticides, namely, imidacloprid and clothianidin, on the foraging activity of Apis 
mellifera. In the trials conducted with imidacloprid, all bees of the control groups 
and the groups treated with doses of 0.15 and 1.5 ng/bee returned to the hive after 
posttreatment release at the feeder, 95% returned when treated at 3 ng/bee, but only 
25% of the bees returned after administration of 6 ng of imidacloprid/bee. Among 
the bees treated with 3 and 6 ng of imidacloprid/bee that were not directly flying 
to the hive, the authors [60] observed reduced mobility, followed by a phase of 
motionlessness with occasional trembling and cleaning movements. The number of 
feeder visits for bees treated with 1.5 and 3 ng of imidacloprid compared to control 
bees during the 3 h observation period after administration was reduced by 47% 
and 98%, respectively. The administration of 1.5 and 3 ng of imidacloprid signifi- 
cantly prolonged the median duration needed for a single foraging trip by 5096 and 
130%, respectively, during the first 3 h observation period. The median flight time 
to the feeder was also prolonged by 64.7% and 241.1%, the time spent at the feeder 
by 27.5% and 45.6%, and the median flight time from the feeder to the hive by 20% 
and 210%, respectively. In the trials conducted with clothianidin, all bees treated 
with 0 and 0.05 ng/bee returned to the hive. At 0.5 ng/bee, 94.4% of them returned 
to the hive during a 3 h observation period immediately after treatment. Among the 
bees treated with 1 ng, only 73.8% returned to the hive and only 20.6% returned 
after the uptake of 2 ng/bee. Abnormal reactions were observed after the release at 
the feeder site following the administration of 1 and 2 ng/bee of clothianidin. Bees 
were moving around with an awkwardly arched abdomen, sometimes followed by 
a phase of turning upside down and lying on the back with paddling leg move- 
ments [60]. During the 3 h observation period after administration of 0.5 and 1 ng 
of clothianidin, the number of feeder visits per bee compared to the control group 
was reduced by 31% and 71%, respectively. The administration of 0.5, 1, and 2 ng of 
clothianidin/bee significantly prolonged the median duration of a foraging trip by 
20%, 32.2%, and 109.3%, the time spent at the feeder by 14.1%, 39.9%, and 101.8%, 
the median flight time back to the hive by 30%, 40%, and 90%, and the median 
time interval of an in-hive stay between foraging trips by 15.8%, 36.7%, and 95.9%, 
respectively. For both insecticides, the adverse effects could persist after 24 h only 
for the highest doses. 

Parasites are known to induce changes in the normal behavior of their hosts. 
Thus, the microsporidia Nosema apis and Nosema ceranae infect the epithelium of 
the ventriculum (midgut) of honey bees, inducing changes in their physiology and 
behavior. The former type of modifications relies mainly on the alteration of diges- 
tive functions [61]. Reduction in the development of the hypopharyngeal glands was 
also observed, leading to a more rapid switch from nursing to other tasks in infected 
bees [62,63]. A lifespan reduction was observed in Nosema-infected bees [64] as 
well as alterations of flight, orientation, and homing behavior [65]. Interestingly, 
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Schneider [66] used RFID tags in a 2-year experiment to monitor the potential 
behavioral changes of honey bees experimentally infected by Nosema spores. A 
reduction of 14% and then of about 62% in the lifespan was observed in contami- 
nated bees. Effects on the time spent outside the hive were also studied. When com- 
paring the time duration that infected and noninfected bees spent outside their hive 
during the different weeks of their life, a significantly longer time of absence was 
found for infected bees during weeks three to five in the first year. The duration was 
1.6, 1.74, and 1.54 times longer compared to noninfected bees, respectively. Similar 
effects were not detected in the second year of the experiments [66]. During the sixth 
and eighth week of life, longer foraging trip durations were recorded for inoculated 
bees. A prolongation factor of 3.3 and 2.3, respectively, was observed compared to 
noninfected bees. However, this difference was statistically not significant. A non- 
significant dependence was observed between increasing foraging activity and lon- 
gevity in contaminated bees [66]. 

Obviously, RFID tags have also found application in the study of physiology, ecol- 
ogy, and ethology of Apis mellifera. Schneider [66] studied the behavioral changes 
in adult honey bees being incubated at different temperatures during their pupal 
development stage. The RFID method was used to monitor groups of bees reared 
at 32°C, 35°C, or 36°C over their lifetime. Immediately after hatching, these bees 
were labeled with RFID transponders and were introduced into a foster registration 
colony for lifelong monitoring of activity, flight durations, and lifespan. Schneider 
[66] observed that bees reared at above-optimal temperature of 36°C were overly 
active and spent the most time outside of the hive compared to the two other tested 
groups of bees (i.e., 32°C and 35°C). Bees reared at an optimal temperature of 35°C 
lived longer than those reared at 36°C and the 32°C [66]. Pahl et al. [67] used RFID 
tags to estimate the homing capability of honey bees. They showed that most of the 
tested bees found their way back home even after blind displacement to unfamiliar 
areas, some of them from up to 11 km. 

To conclude, RFID tags are very interesting devices that allow us to obtain a lot 
of information on bees during their normal activity or when they are faced with envi- 
ronmental pollutants. Figures 1.7 and 1.8 illustrate what kind of information can be 
easily extracted from the analysis of recorded data. Obviously, to be of interest and 
representative, the number of tagged bees has to be at a minimum of some hundreds. 

It is worthy to note that RFID methodology has also found application in the 
study of ecology and ethology of bumblebees. Ohashi et al. [68] developed an experi- 
mental system for producing computer records of multiple foragers harvesting from 
simple artificial flowers with known rates of nectar secretion, using RFID tags to 
identify individual animals. However, the study is of limited interest because it was 
only performed with two tagged Bombus impatiens. Much more interesting is the 
work by Stelzer and Chittka [69], who studied the foraging rhythms of bumblebee 
colonies in northern Finland during the summer when the sun stays above the hori- 
zon for weeks. They showed that Bombus terrestris workers did not use the available 
24 h foraging period but exhibited robust diurnal rhythms instead. Foraging activity 
took place mainly between 8 and 23 h, with reduced or no activity during the rest of 
the day. Activity levels increased steadily during the morning, reached a maximum 
around midday, and decreased again during late afternoon and early evening. It was 
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FIGURE 1.7 Distribution of survival times of tagged bees during the experiment. 
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FIGURE 1.8 Number of outgoing trips per tagged bee and per day of experiment. Stars 
indicate minor problems in data recording. 


previously shown that under controlled laboratory conditions, foragers showed free- 
running circadian rhythms both in constant light and darkness [70]. Foraging pat- 
terns at the nest entrance of native B. pascuorum, the native bumblebee, followed the 
same temporal organization, with the foraging activity being restricted to the period 
between 6 and 22 h [69]. 
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1.3.2 OTHER TECHNIQUES 


Attempts have been made to use bar codes to detect the individual behavior of 
honey bees [71]. However, although the method is cheap, it is not widely used 
because the reading of the codes is impossible when the bee is not perpendicular to 
the laser scanning reader or when the bar code is not clean enough [44]. Conversely, 
while the harmonic radars are expensive, they are increasingly used due to their 
ability to track in real time the flying activity of insects [44]. Riley et al. [72] were 
the first to test such a technology on honey bees. Figure 1.9 shows a bee equipped 
with a transponder for radar detection. Capaldi et al. [73] used harmonic radar 
to study the ontogeny of orientation flight of honey bees in a flat region of farm- 
land (700x900 m) planted with cereal crops and surrounded by flowering crops, 
hedges, wooded areas, and buildings. Transponders weighing 0.8 and 12 mg were 
attached to bees as they departed from the hive, and orientation flight tracks were 
recorded by the radar. Of the 53 radio-tagged bees, the authors analyzed 29 full 
orientation flight sequences taken by bees of different ages (3-27, median = 6 days), 
with various degrees of experience (1—17 orientation flights). For comparison pur- 
poses, they also tracked flights (n2 15) taken by experienced foragers of unknown 
age from the same hive [73]. Capaldi et al. [73] demonstrated that with increased 
experience, honey bees hold trip duration constant but fly faster. Consequently, 
later trips covered a larger area than the earlier ones. Each flight was typically 
restricted to a narrow sector around the hive. Orientation flights provide bees with 


FIGURE 1.9 A honey bee carrying a transponder for radar detection. (From Comput. 
Electron. Agric., 35, Riley, J.R. and Smith, A.D., Design considerations for an harmonic radar 
to investigate the flight of insects at low altitude, 151—169, Copyright [2002], with permission 
from Elsevier.) 


18 In Silico Bees 


repeated opportunities to view the hive and its environment from different view- 
points, suggesting that they progressively learn the local landscape. The authors 
showed that changes in orientation flight were related to previous flights rather than 
chronological age, suggesting a learning process adapted to changes in the abiotic 
and biotic factors [73]. 

Harmonic radars were also used for capturing the activity of other Hymenoptera. 
Thus, Osborne et al. [74] used a harmonic radar (vertical dipole aerial 16 mm long, 
12 mg) to study the foraging behavior of bumblebees (Bombus terrestris). The 
authors showed that outward tracks had a mean length of about 275 m with a range of 
110—631 m and were often to forage destinations beyond the nearest available forage. 
Most bumblebees were constant to compass bearing and destination over successive 
trips. The bees' ground speeds ranged from 3 to 15.7 m/s in various wind conditions 
[74]. Lihoreau et al. [75] investigated the acquisition of long-distance traplines by 
foraging bumblebees (B. terrestris) with known foraging experience by first training 
them to forage on five artificial flowers arranged in a regular pentagon (50 m side 
length) within a field, then by tracking their complete flight paths with harmonic 
radar, and finally recording all their flower visits with motion-sensitive cameras. 
Stable traplines that linked together all the flowers in an optimal sequence were 
typically established after 26 foraging bouts, during which time only about 20 of the 
120 possible routes were tried by the bumblebee. Radar tracking of selected flights 
revealed a strong decrease by 80% (ca. 1,500 m) of the total travel distance between 
the first and the last foraging bout. When the spatial configuration of flowers was 
modified, the bees engaged in localized search flights to find new flowers. Lihoreau 
et al. [75,76] suggested that bumblebees developed their traplines through trial and 
error by combining exploration, learning, and sequential optimization. It is notewor- 
thy that information on the use of harmonic radars to study the flying behavior of 
insects, especially honey bees and bumblebees, can be found in Riley and Smith [77] 
and Riley et al. [78]. 

The carpenter bee (Xylocopa flavorufa) is one of the main pollinators of cow- 
pea (Vigna unguiculata) in Kenya. This large solitary bee flies very quickly, ruling 
out most of the conventional techniques used to study its foraging flights [79]. Its 
nests are burrowed in dead branches located at the top of trees found in wooded 
landscapes. This excluded the use of harmonic radars, which only allow us to fol- 
low individuals in open habitat where radar beams are not blocked by vegetation 
and where bees do not fly outside the reference areas. To overcome this problem, 
Pasquet et al. [79] used small radio transmitters (0.35 g=a third of their average 
weight, antenna- 14 cm) to assess both the distance between the bee's nest and one 
of its foraging locations and how many places were visited during a single foraging 
trip. The range of the transmitters (around 200 m at soil level) and the large potential 
target area (near 300 km?) requested the use of an aircraft for locating the transmit- 
ters. Experiments were made during the Kaskazi and Kusi seasons showing different 
climatic conditions. Pasquet et al. [79] found that carpenter bees were able to forage 
up to 6 km from their nest. Bees flew significantly shorter distances during poor 
weather conditions, even with roughly similar flower densities. Long flights were 
correlated with the presence of wind. The results obtained by Pasquet et al. [79] 
suggested X. flavorufa had the potential to move pollen over several kilometers and, 
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hence, between domesticated and wild cowpea populations, leading to problems if 
the former population was genetically modified. 

Neotropical orchid bees (Euglossini) can travel very large distances to collect 
fragrances, food, or nesting material. Wikelski et al. [80] used radio transmitters 
(Sparrow Systems, Fisher, IL, 300 mg, 2 radio pulses/s, 378 MHz, antenna length 42 
mm) to track the movements of males of Exaerete frontalis in a complex and forested 
environment. This cleptoparasitic euglossine species was selected due to its abun- 
dance, ecology, and also large size (about 600 mg), which allowed the fixation of a 
relatively heavy transmitter. Of the 16 radio tagged bees, four were lost. The remain- 
ing bees were followed by ground surveys and helicopter tracking overflights. The 
results showed that bees habitually used large rainforest areas (at least 42-115 ha) on 
a daily basis. Aerial telemetry located individuals up to 5 km away from their core 
areas, and bees were often stationary, for variable periods, between flights to succes- 
sive localities [80]. 

Recently, Hagen et al. [81] used micro radio telemetry (Advanced Telemetry 
Systems, Isanti, MN, Series A2405, 200 mg, antenna length shortened to ca. 3 cm) 
to track flight distances and space use of bumblebees. Using ground surveys and 
Cessna overflights in a Central European rural landscape mosaic, they obtained 
maximum flight distances of 2.5, 1.9, and 1.3 km for Bombus terrestris (workers), 
Bombus ruderatus (workers), and Bombus hortorum (young queens), respectively. 
Bumblebee individuals used large areas (0.25—43.53 ha) within one or a few days. 
Habitat analyses of one B. hortorum queen at the landscape scale revealed that gar- 
dens within villages were used more often than expected from habitat availability. 
Detailed movement trajectories of this individual revealed that prominent land- 
scape structures (e.g., trees) and flower patches were repeatedly visited. However, 
Hagen et al. [81] also observed long (i.e., >45 min) resting periods between flights 
(B. hortorum) and differences in flower handling between bumblebees with and 
without transmitters (B. terrestris), suggesting that the weight of transmitters was 
too high, leading to a significant energetic cost. 


1.4 CONCLUDING REMARKS 


Different technologies are available to tag and track honey bees and to automatically 
record their activity. Although a fundamental difference has to be made between theo- 
retical studies that attempt to show the applicability potential of a new technology and 
a field study that aims to respond to a specific problem, such as the potential adverse 
effects of an insecticide, choosing the best technique for marking and tracking bees 
relies on the goal, duration, and constraints of the study, cost-effectiveness ratio, and 
training experience, to only cite the most influential factors. If we consider the other 
hymenopterans discussed in this chapter, deciding which marking/tracking technique 
is best also includes considering their size, life stage, sex, ecology, and ethology. 
Independent of these crucial aspects, tracking bees with these new devices 
implies that data are sequentially or continuously recorded and, hence, have to be 
analyzed. Data analysis often starts by a phase of cleaning, especially when numer- 
ous bees have been tagged and tracked. In practice, different situations can occur. If 
bee activity is recorded over a long period of time, some bees can lose their tag, or 
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a problem could occur in recording data (e.g., flattened battery). A cleaning phase 
also exists with systems recording the whole behavior of bees at the hive entrance. 
The most common approach to deal with missing data is to delete cases contain- 
ing missing observations. Unfortunately, this always leads to a loss of information 
that can impact the interpretation of the results, especially if the number of tagged 
bees is limited. There exist methods to handle missing data (see, e.g., [82—86]), 
and it would be highly beneficial to use them. On the contrary, the goal of the 
study may require that the recorded data be censored. Thus, for example, the use of 
RFID tags to study the flying behavior of honey bees requires deleting the recorded 
data corresponding to the time when the bee stays at the hive entrance and on the 
artificial feeder, if any. 

Regression analyses are commonly used for discovering relationships between 
the recorded data and various predictors judged influential. The goal seems to be 
to obtain the highest possible correlation coefficient in order to orientate the eco- 
logical interpretation of the results. Unfortunately, very often, this is done without 
verifying whether the approach used was appropriate or not [87—89]. On the other 
hand, exploratory data analysis allows us to deeply investigate the data and optimally 
formulate hypotheses, leading to a better interpretation of results. Techniques exist 
to extract step by step the different influential variables [90] in order to explain how 
they are related to all the activity data automatically recorded during the experi- 
ments. These techniques also allow us to better interpret the outliers. 
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ABSTRACT 


One of the unique features of the organization in honey bee societies is the ability 
to adapt to environmental circumstances in a highly decentralized way. This adap- 
tation takes the form of changes in the allocation of bees to roles, whereby bees 
individually decide to take up certain roles that require attention. Within the domain 
of computational modeling of multiagent systems, a trend has developed to model 
such systems from an organizational perspective. Usually this is done by describ- 
ing multiagent systems as organizations using structural elements such as roles and 
groups and behavioral properties of these elements, for example, expressions for 
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role behavior, specifying how agents should behave once they fulfill a certain role. 
In dynamic environments, changes in environmental circumstances may require 
changes in such organizations as well. In this chapter, the change process as seen 
in honey bee colonies has been modeled by means of techniques from the domain 
of multiagent organizations. This results in an adaptive multiagent organizational 
model that is able to cope with changing environmental circumstances. 


KEYWORDS 


Organizational modeling, Multiagent organizations, Agent systems, Adaptive role 
allocation, Honey bee colonies 


21 INTRODUCTION 


In the literature, it has been shown that honey bees (Apis mellifera) are very effective 
in adapting their organization based on the environmental circumstances that the 
colony is experiencing [1,2]. Within the colony, several specialized roles are present, 
such as brood carers that take care of feeding larvae, patrollers that guard the hive 
against enemies, foragers who harvest food outside of the hive, undertakers who 
remove corpses from the hive, and resting workers who do not engage in any activi- 
ties. Bees switch between these roles triggered by changes that they observe in the 
environment. Such observations differ per bee. Each role has a specific trigger for 
which a bee has a certain threshold that determines whether this is the role it should 
play. The bee always plays the role for which it is most triggered. For example, bees 
are triggered to start playing the brood carer role when they observe the larvae emit- 
ting a very high level of hunger pheromones. Once they are allocated to the role, they 
start getting food from the combs and feed the larvae that are emitting the phero- 
mones. A trigger for the patroller role is the number of enemies observed around the 
hive. Foragers that have returned from their hunt for food communicate the location 
where they found the food by means of the honey bee dance (see [3]). For other bees 
currently not playing the forager role, such a dance is a trigger to start playing the 
forager role. The more corpses there are, the more bees are being triggered to switch 
from their current role to being undertaker. Bees perform the resting worker role in 
case they are not sufficiently triggered for any other role. 

The aforementioned provides an excellent mechanism to change an organization 
effectively. Within artificial intelligence, modeling of organizations [4] has recently 
received attention in the discipline of multiagent systems [5-7]. Within multiagent 
systems, there is a tendency to analyze and design more and more complex sys- 
tems consisting of larger numbers of agents (e.g., in nature, society, software). Due 
to this increasing complexity, the need arises for a concept of higher abstraction 
than the concept agent in order to still oversee the functioning of such a system. 
To this end, organizational modeling is becoming a practiced stage in the analysis 
and design of multiagent systems. Hereby, the environment in which the multiagent 
organization participates has to be taken into consideration. An environment can 
have a high degree of variability, which might require organizations that change to 
adapt to the environment's dynamics to ensure a continuous proper functioning of 
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the organization. Hence, such change processes are a crucial function of the orga- 
nization and should be part of the organizational model. In order to model these 
change processes, a more central perspective can be taken, which is, for instance, 
presented in Hoogendoorn et al. [8]. Hereby, there is a central authority in place that 
performs changes in case it is necessary to do so, given the goals of the organiza- 
tion and the environmental circumstances. An alternative is to take a decentralized 
perspective (for instance, in case there is no such central authority) whereby each 
individual member of the organization decides upon a change by himself or herself. 
In order to model such decentralized change, the mechanism as explained for honey 
bees earlier can be used. 

This chapter presents a model for decentralized organization change that incor- 
porates the change mechanism as seen in honey bee colonies and extends the work 
presented by the authors [9]. Such a model can aid developers of multiagent systems 
in creating and analyzing such an organization with change characteristics and also 
allows the studying of these kinds of organizations (e.g., studying changes in honey 
bee colonies). The description of the model abstracts from the actual tasks being 
performed by the organization. The scope of the model is broader than simply being 
able to model social insects: the mechanisms incorporated in the model facilitating 
decentralized organizational change may work in other types of organizations as 
well. In Bonebeau and Theraulaz [10], for example, a comparable approach is used 
for finding an optimal allocation of cars to paint booths. Note that the model is illus- 
trated by means of examples from the domain of honey bees. These illustrations are 
simplifications of the actual processes encountered in honey bee colonies and are not 
meant to model the real process, but as an illustration of the application and expres- 
siveness of the proposed modeling approach. 

Section 2.2 presents the modeling approach used. The model describing orga- 
nizational change using the approach as seen in honey bee colonies is described in 
Sections 2.3 and 2.4. Results of a simulation of the organizational model for a bee 
colony are shown in Section 2.5, and finally Section 2.6 concludes the chapter. 


2.2 MODELING ORGANIZATIONAL DYNAMICS 


In order to model the phenomena that occur within honey bee organizations, two 
elements are needed. First, a way to represent the structure of the organization 
and second, a representation of the behavior of the organization is required. For 
the representation of the structure of the organization, AGR (agent/group/role) as 
introduced by Ferber and Gutknecht [11,12] is used, which is presented in Section 
2.2.1. Section 2.2.2 introduces the approach used to express the behavior of the 
multiagent organization. 


2.2.1 REPRESENTING ORGANIZATIONAL STRUCTURE 


For the structural description of multiagent organizations, the AGR model has been 
adopted [7,11,12]. The three primitive definitions are as follows. 

The agents: The model places no constraints on the internal architecture of 
agents. An agent is only specified as an active communicating entity that plays roles 


30 In Silico Bees 


Group 3 


FIGURE 2.1 Example organization modeled within AGR. 


within groups. This agent definition is intentionally general to allow agent designers 
to adopt the most accurate definition of agenthood relative to their application. 

A group is defined as an atomic set of roles. Each agent plays a role in one or more 
groups. In its most basic form, the group is only a way to tag a set of roles. An agent 
can contribute to multiple groups at the same time. A major point of these groups is 
that they can freely overlap. 

A role is an abstract representation of an agent function, service, or identification 
within a group. Each agent can handle multiple roles, and each role handled by an 
agent is local to a group. 

AGR distinguishes three aggregation levels: the organization as a whole, groups, 
and roles, as illustrated in Figure 2.1. The large ovals denote groups whereas the 
smaller ovals denote the roles within the organizations. Furthermore, the solid arrows 
denote intragroup interactions between roles within a given group, and the dashed 
lines represent intergroup interactions. Agents realizing the roles are not depicted. 
However, the specification of the aggregation levels can place additional constraints 
on the agents that are to realize the roles. For example, the dashed lines between role 1 
and role 3 could indicate that those roles will have to be fulfilled by the same agent. 


2.2.2 REPRESENTING ORGANIZATIONAL BEHAVIOR 


Describing the structure of an organization is not enough; the behavior has to be 
described as well. For example, the intragroup interactions in Figure 2.1 describe 
that role 5 can communicate to role 6, but it does not describe when this should occur 
nor what content is to be communicated. 

The specification of behavior follows the same aggregation levels as identified in 
AGR, namely, the level of roles, groups, and the organization as a whole. The impor- 
tance of such aggregation levels and the relation between these aggregation levels are 
emphasized by Lomi and Larsen [13]. In the introduction to their book, they describe 
the following as main challenges in the field: 


* "Given a set of assumptions about (different forms of) individual behavior, 
how can the aggregate properties of a system be determined (or predicted) 
that are generated by the repeated interaction among those individual units?" 
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* “Given observable regularities in the behavior of a composite system, which 
rules and procedures—if adopted by the individual units—induce and sus- 
tain these regularities?" 


Both views and problems require means to express relationships between dynamics 
of different elements and different levels of aggregation within an organization. The 
different aggregation levels of the behavioral specification are shown in Figure 2.2 
in the form of an AND tree. 

As can be seen, on the highest level of the tree, organizational properties are 
shown, which are properties the organization as a whole needs to achieve. At the 
level below the organizational level, group properties and intergroup interaction 
properties are specified, which together entail the organizational properties. The 
group properties are entailed by the lowest level, namely, role properties and transfer 
properties that specify interactions between roles within the same group. 

The language TTL (Temporal Trace Language), described in Bosse et al. [14] and 
Sharpanskykh and Treur [15], has been adopted for the specification of behavior in 
organizational models; for more formal details on TTL, see Box 2.1. To model direct 
causal or temporal dependencies between two state properties, not the expressive 
language TTL, but the simpler leads to format is used. This is an executable format 
that can be used to obtain a specification of a simulation model in terms of local 
dynamic properties (the leaves of the tree in Figure 2.2). The format is defined as 
follows. Let x and f be state properties of the form “conjunction of literals” (where a 
literal is an atom or the negation of an atom) and e, f, g, h be nonnegative real num- 
bers. In the leads to language, « >, ; , , B, which means: 


If state property a holds for a certain time interval with duration g, then after some 
delay (between e and f) state property B will hold for a certain time interval of 
length h. 


A specification of dynamic properties in leads to format has the advantages that 
it is executable and that it can be depicted graphically in a causal graph-like style. 
TTL comes with a dedicated software environment that has been implemented 
in SWI-Prolog. This software environment allows for the specification of prop- 
erties (both in TTL and the executable subset /eads to), a simulation engine that 
can execute leads to specifications, and an automated property checking tool that 
verifies properties against traces (for instance, resulting from the simulation engine). 
The software is available on a variety of platforms, including Windows and Linux. 


Organization 
properties 
Intergroup interaction Group properties 
properties 
Transfer properties Role properties 


FIGURE 2.2 AND tree of behavioral properties. 
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BOX2.1 FORMAL CONCEPTS USED IN TTL 


In TTL [14], ontologies for states are formalized as sets of symbols in sorted 
predicate logic. For any ontology Ont, the ground atoms form the set of basic 
state properties BSTATPROP(Ont). Basic state properties can be defined by 
nullary predicates (or proposition symbols), such as incident, or by using n-ary 
predicates (with n>0) like observes (number of casualties, 7). The state 
properties based on a certain ontology Ont are formalized by the propositions 
(using conjunction, negation, disjunction, implication) made from the basic 
state properties and constitute the set STATPROP(Ont). 

Important concepts to express dynamics in TTL are states, time points, and 
traces. A state S is an indication of which basic state properties are true and 
which are false, that is, a mapping S: BSTATPROP(Ont) > (true, false}. The set 
of all possible states for ontology Ont is denoted by STATES(Ont). Moreover, a 
fixed time frame T is assumed, which is linearly ordered. Then, a trace y over 
a state ontology Ont and time frame T is a mapping y: T > STATES(Ont), that 
is, a sequence of states y, (t € T) in STATES(Ont). The set of all traces over 
ontology Ont is denoted by TRACES(Ont). 

The set of dynamic properties DY NPROP(Ont) is the set of temporal state- 
ments that can be formulated with respect to traces based on the state ontology 
Ont in the following manner. Given a trace y over state ontology Ont, a certain 
state at time point t is denoted by state(y, t). These states can be related to state 
properties via the formally defined satisfaction relation, indicated by the infix 
predicate I=, and comparable to the Holds predicate in the situation calculus. 
Thus, state(y, t) l= p denotes that state property p holds in trace y at time t. 
Likewise, state(y, t) lZ p denotes that state property p does not hold in trace 
y at time t. Based on these statements, dynamic properties can be formulated 
in a formal manner in a sorted predicate logic, using the usual logical con- 
nectives such as ^, A, V, > and the quantifiers V, 3 (e.g., over traces, time and 
state properties). The set DYNPROP(Ont, y) is the subset of DYNPROP(Ont) 
consisting of formulae with y occurring in which it is either a constant or a 
variable without being bound by a quantifier. 


TTL has some similarities with the situation calculus [16] and the event calculus 
[17], which are two well-known formalisms for representing and reasoning about 
temporal domains. However, a number of important syntactic and semantic distinc- 
tions exist between TTL and both calculi. In particular, the central notion of the 
situation calculus—a situation—has different semantics than the notion of a state in 
TTL. That is, by a situation is understood a history or a finite sequence of actions, 
whereas a state in TTL is associated with the assignment of truth values to all state 
properties (a “snapshot” of the world). Moreover, in contrast to the situation calcu- 
lus, where transitions between situations are described by actions, in TTL, actions 
are in fact properties of states. Moreover, although a time line has been recently 
introduced to the situation calculus [15], still only a single path (a temporal line) 
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in the tree of situations can be explicitly encoded in the formulae. In contrast, TTL 
provides more expressivity by allowing explicit references to different temporally 
ordered sequences of states (traces) in dynamic properties. Regarding event cal- 
culus, TTL does not employ the mechanism of events that initiate and terminate 
fluently whereas event calculus does. Events in TTL are considered to be functions 
of the external world that can change states of components, according to specified 
properties of a system. Furthermore, similar to the situation calculus, in the event 
calculus, only one time line is considered. TTL can also be related to temporal lan- 
guages that are often used for verification (e.g., propositional temporal logic [PTL] 
and linear-time logic [LTL] [18—20]). It is possible to translate properties expressed 
in these languages in TTL. However, the translation is not bidirectional, that is, it is 
not always possible to translate TTL expressions into LTL expressions. See Bosse 
et al. [14] for more details. 


2.3 ORGANIZATIONAL PROPERTIES 


In order to model the change process as observed in honey bee colonies, a first start 
is made by considering desired behavior of the organization as a whole by means of 
organizational properties, including the relationships between these organizational 
properties. The formal specifications in TTL of the dynamic properties discussed in 
the following can be found in Box 2.2. The highest level requirement for the orga- 
nization as a whole as inspired by the biological domain knowledge is survival of 
the population given a fluctuating environment; in other words, the population size 
always needs to reach a level above a certain threshold M. 


OP1(M) Surviving Population 


For any time t, a time point t' > t exists such that at t' the population size is at 
least M. 


BOX2.2 FORMAL SPECIFICATIONS OF DYNAMIC 
ORGANIZATION PROPERTIES IN TTL 


OP1(M) Surviving Population 
Vt At’ > t, v: state(y, t’) l= total. living population count(v) & v > M 


OP2(X, P1, P2) Organization Aspect Maintenance 
Vt, v: state(y, t) = has value(X, v) > P1 < v < P2 


OP3(X, W1, W2) Sufficient Aspect Effort 
Vt, v: state(y, t) l= provided_effort(X, v) > W1 < v < W2 


OP4(X, B, d) Adaptation Flexibility 
Vt, v1 [[state(y, t) l= provided_effort(X, v1) & v1 <B] > 
At’ > t, v2: [t < t+d & state(y, t’) I= provided effort(X, v2) & v2 > B|] 


RP(R, d, W) Worker Contribution 
Vt At’ > t, v: [t < ted & state(y, t’) I= work. contribution(R, v) & v > W]] 
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maintenance 
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RP3(M) RP3(M) 


FIGURE 2.3 Property hierarchy for decentralized organizational change. 


This high-level requirement is refined by means of a property hierarchy, depicted as 
a tree in Figure 2.3. At the highest level, OPI is depicted, which can be refined into 
a number of properties (in Figure 2.3, n properties) each expressing that for a certain 
aspect the society is in good condition, characterized by a certain value for a variable 
(the aspect variable) that is to be maintained. The property template for an aspect 
X is as follows: 


OP2(X, P1, P2) Organization Aspect Maintenance 
For all time points t 
If v is the value of aspect variable X at t, then v is between P1 and P2 


Sometimes, one of the two bounds is omitted, and it is only required that value v 
is at least P1 (resp., at most P2). For the honey bee society, the aspects considered 
are well-fed brood, safety, food storage, and cleanness (addressed, respectively, by 
brood care, patroller, forager, and undertaker roles as explained in Section 2.1). For 
each of these aspects, a variable was defined to indicate the state of the society for 
that aspect. For example, for well-fed brood, this variable concerns relative larvae 
hunger, indicated by the larvae pheromone rate. 

In order to maintain the value of an aspect variable X, a certain effort is needed 
all the time. To specify this, a property that expresses the effort made by the orga- 
nization on the aspect is introduced. Notice that the notion of provided effort at a 
time point t can be taken in an absolute sense (e.g., effort as the amount of feeding 
work per time unit), but it can also be useful to take it in a relative sense with respect 
to a certain overall amount, which itself can vary over time (e.g., effort as the frac- 
tion of the amount of feeding work per time unit divided by the overall number of 
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larvae). Below the latter, relative form will be taken. The general template property 
for aspect effort is as follows: 


OP3(X, W1, W2) Sufficient Aspect Effort 


For all time points t, the effort for aspect X provided by the organization is at least 
W1 and at most W2. 


For the bee colony, the brood care workers take care that the larvae are well fed. The 
effort to maintain the hunger of larvae at a certain low level is feeding the larvae. 
Here, provided effort for brood care is defined as the brood care work per time unit 
divided by the larvae population size. Brood care work is taken as the amount of 
the (average) brood care work for one individual brood carer times the number of 
brood carers. 

Whether the refined properties given earlier will always hold depends on the 
flexibility of the organization. For example, in the honey bee colony, if the num- 
ber of larvae or enemies increases, the number of brood care workers or patrollers, 
respectively, should also increase. If the adaptation to the new situation takes too 
much time, the property Brood Care Effort will not hold for a certain time. In prin- 
ciple, such circumstances will damage the success of the organization. Therefore, an 
adaptation mechanism is needed that is sufficiently flexible to guarantee the proper- 
ties such as Brood Care Effort. For this reason, the adaptation flexibility property 
1s introduced, which expresses that when the effort for a certain organization aspect 
that is to be maintained is below a certain value, then within a certain time duration 
d it will increase to become at least this value. The smaller this parameter d is, the 
more flexible is the adaptation; for example, if d is very large, the organization is 
practically not adapting. The generic property is expressed as follows: 


OP4(X, B, d) Adaptation Flexibility 


At any point in time t, if the effort for aspect X provided by the organization is 
lower than B, then within time duration d the effort will become at least B. 


An assumption underlying this property is that not all aspects in the initial situation 
are critical, otherwise the adaptation mechanism will not work. OP3 expressing that 
sufficient effort is being provided directly depends on this adaptation mechanism 
is shown in Figure 2.1. OP4 depends on role properties at the lowest level of the 
hierarchy, which are addressed in the next section. 


2.4 ROLE PROPERTIES 


Roles are the engines for an organization model: they are the elements in an organi- 
zation model where the work that is done is specified. The properties described in 
Section 2.3 in a hierarchical manner have to be grounded in role behavior properties 
as the lowest level properties of the hierarchy. In other words, specifications of role 
properties are needed that entail the properties at the organizational level described 
in Section 2.3. In the behavioral model, two types of roles are distinguished: worker 
roles that provide the effort needed to maintain the different aspects throughout 
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the organization and member roles that have the function to change worker roles. 
Each member role has exactly one shared allocation with a worker role. The role 
behavior for the worker roles within the organization is shown in Section 2.4.1, 
whereas Section 2.4.2 specifies the behavior for the member roles. Note that the 
level of groups has not been used throughout this model, but one can easily see that 
certain roles can be grouped according to the tasks that are being performed. 


2.4.1 Worker ROLe BEHAVIOR 


Once a certain worker role exists as an active role, it performs the corresponding 
work. What this work exactly is depends on the application: it is not part of the 
organization model. The property directly relates to OP4, which specifies the overall 
effort provided, as shown in Figure 2.1. Note that Figure 2.1 only shows the generic 
form of the role property (depicted as RP(w(a,),d;,W;), where a, is the specific aspect 
and w(a;) the worker role belonging to that aspect), whereas in an instantiated model, 
arole property is present for each instance of the worker role providing the effort for 
the specific aspect. In a generic form, this is specified by 


RP(R, d, W) Worker Contribution 


For all t there is a U with t € t < t+d such that at t’ the worker role R delivers a 
work contribution of at least W. 


Here work contribution is used as part of the state ontology for the output of the role 
(see Box 2.2). For each of the specific roles, it can be specified what the work contri- 
bution is in terms of the domain-specific state ontology (e.g., the number of larvae to 
be fed for the brood carer role). 


2.4.2 MEMBER ROLE BEHAVIOR 


By a member role M, decisions about taking up or switching between worker roles 
are made. As input of this decision process, information is used about the well-being 
of the organization, in particular about the different aspects distinguished as to be 
maintained; these are input state properties indicating the value of an aspect variable 
X: has_value(X, v). Based on this input, the member role M generates an intermedi- 
ate state property representing an indication of the aspect that is most urgent in the 
current situation. In the model, the decision mechanism is indicated by a priority 
relation priority relation (X,, vj, W,,---, Xn» Vn Wp X), indicating that aspect X has 
priority in the context of values v; and norms w; for aspects X,,..., X,. This priority 
relation can be specialized to a particular form, as shown by an example specializa- 
tion in the last paragraph of this section. For formal specifications in TTL of these 
role properties, see Box 2.3. 


RP1(M) Aspect Urgency 


At any t, if member role M has norms w, to w, for aspects X, to X, and receives 
values v, to v, for X, to X, at its input, and has a priority relation that indicates X 
as the most urgent aspect for the combination of these norms and values, then at 
some t' >t it will generate that X is the most urgent aspect. 
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BOX2.3 FORMAL SPECIFICATIONS OF 
DYNAMIC ROLE PROPERTIES IN TTL 


RP1(M) Aspect Urgency 

Vt, v1,.., vn, wl,.., wn, X 

state(y, t) I= has_value(X,, vj) & ... & has_value(X,, Va) & 
has_norm(X,, w,) & ... & has norm(X,, w,) & 

priority relation(X,, vj, W,,..., X,, Vas Wn» X) 

=> dt’ >t state(y, t’) I= most urgent. aspect(X) 


RP2(M) Role Change Determination 

Vt, X, R1, R2 state(y, t) |= most_urgent_aspect(X) & 

role responsible for(R2, X) & role reserved for(R2, M) & 
state(y, t) |= has. shared allocation(M, R1) & RIZR2 

=> dt’ >t state(y, tU) I= shared allocation change(M, R1, R2) 


RP3(M) Role Reallocation 

Vt, R1, R2 

state(y, t) l= shared. allocation change(M, R1, R2) 

=> 3t' >t state(y, t') I= not has. shared allocation(M, R1) & 
has. shared. allocation(M, R2) 


Based on this, the appropriate role for the aspect indicated as most urgent is deter- 
mined. If it is not the current role sharing an allocation with M, then another inter- 
mediate state property is generated expressing that the current worker role sharing an 
allocation with M should be changed to the role supporting the most urgent aspect. 
In other words, the shared allocation of member role M in the change group should 
change from one (the current) worker role R1 in worker group WGI to another one, 
worker role R2 in worker group WG2: 


RP2(M) Role Change Determination 

At any time t, if member role M generated that X is the most urgent aspect, worker 
role R2 is responsible for this aspect, R1 is the current worker role sharing an allo- 
cation with M, and R1 # R2, then at some t' > t it will generate that role R2 has to 
become the worker role sharing an allocation with M, instead of R1. 


Based on this intermediate state property, the member role M generates output indi- 
cating which role should become a shared allocation and which should not anymore: 


RP3(M) Role Reallocation 


At any t, if member role M generated that worker role R2 has to share an allocation 
with M, instead of worker role R1, then at some t' > t it will generate the output that 
role R1 will not share an allocation with M and R2 will share an allocation with M. 


All three role properties for the member roles are depicted in Figure 2.3. The adapta- 
tion step property OP4 for all organizational aspects is dependent upon it, so each 
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of the OP4 branches depends upon RPI, RP2, and RP3, which have therefore been 
depicted two times in the figure. 

The generic description for the member role behavior can be specialized one step 
further by incorporating a specific decision mechanism. This gives a specific defini- 
tion of the priority relation priority_relation(X,, vj, W,,..., X,, Vn Wa» X) as has been 
done for the following decision mechanism based on norms used as thresholds (see, 
e.g., [10] for a more elaborate description of this mechanism within honey bees): 


1. For each aspect X to be maintained, a norm w(X) is present. For the worker 
role R1 for X sharing an allocation with member role M, each time unit the 
norm has a decay described by fraction r. 

2. For each X, it is determined how far the current value is unsatisfactory, 
expressed in a degree of urgency u(X) for that aspect. 

3. For each aspect with urgency above the norm, that is, with u( X)» w(X), the 
relative urgency is determined: u(X)/w(X). 

4. The most urgent aspect X is the one with highest relative urgency. 


2.5 SIMULATION RESULTS 


This section discusses the results of simulations that have been performed based on 
the organizational model, in particular the role properties presented in Section 2.4 
have been put in an executable format and have been instantiated with domain-specific 
information for bee colonies (as the properties expressed in Sections 2.3 and 2.4 
were highly generic and, hence, reusable for other domains as well). 

To validate the instantiated simulation model, the high-level dynamic properties 
from Section 2.3 were used (in accordance with biological experts). Proper func- 
tioning of such an organization in nature is not self-evident; therefore, two simula- 
tion runs are compared: one using the adaptation mechanism and one without. The 
choice has been made to compare the result of using adaptation with no adaptation 
due to the fact that comparing with centralized change will obviously result in better 
performance of the centralized change model. Having a complete picture of the dif- 
ferent aspects and their urgencies gives a major advantage. Whether decentralized 
adaptation is more successful than no adaptation is however not a trivial matter. In 
case there is merely coordination by means of observables in the world (which is the 
case in honey bee colonies), adaptation might even be counterproductive. Note that 
the results presented here are the results of a simulation of the instantiated organiza- 
tional model, abstracting from allocated agents. Performing such high-level simula- 
tions of an executable organizational model enables the verification of properties 
against these simulation runs. Hence, it can be checked whether or not the model 
satisfies the properties or goals considered important. When such properties are 
indeed satisfied, by allocating agents to the roles that comply to the role properties, 
the multiagent system delivers the desired results as well. In the two simulations, 
several parameters have been set to certain values, where the circumstances are kept 
identical for both simulations. 


External world: Initially, 15 larvae and 10 workers are present for which the initial 
type of the latter is randomly assigned. The natural mortality age is set to 500 time 
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steps, whereas a larva is grown up after 250 time steps. Every 20 time steps, a new 
larva is added to the population. The initial food stock is set to 40 units of food. 
Once every 100 time points, an attack of 40 enemies occurs, who stay there until a 
patroller defeats them. In case over 200 enemies are present in the hive, each indi- 
vidual in the organization is removed with a probability of 0.05 per time step. In 
case more than 20 dead bodies are present in the hive, individuals are removed with 
the same probability. Food used by larvae is 0.5 per feed, and for workers 1 unit of 
food per time step. 


Larvae: Larvae have an initial pheromone level of 0.5, increasing 0.006 per time 
step. In case pheromone emissions exceed 0.95, the larva dies. After being fed, the 
emission level is set to 0.1. 


Foragers: Foragers each collect three food units per time step. 


Brood carers: Feed 1 larva per 8 time steps, and only feed the larvae with a phero- 
mone level above 0.55. 


Undertaker: Carry 1 body per 12 time steps. 


Patroller: Defeat 1 enemy per time step. 

In the adaptation simulation, the member thresholds are randomly generated, 
being somewhat above or below the average observed value of the various triggers. 
In Figures 2.4 and 2.5, the results of 20 runs of the model using the adaptive approach 
presented in Sections 2.2 and 2.3 versus no adaptation are shown. Figure 2.4 shows 
the population size over time, whereas Figure 2.5 shows one specific aspect of the 
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FIGURE 2.4 Population size with and without adaptation. 
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FIGURE 2.5 Hunger level with and without adaptation. 


population, namely, the hunger level. Approximations of the trends are also shown, 
which are based upon a second-order polynomial function. 

Figure 2.4 clearly shows that the approach whereby adaptation is used results in a 
bigger population due to the fact that the various aspects can be sustained for these 
higher population levels. In Figure 2.5, it can be seen that the overall hunger level in 
the case with adaption is slightly higher, and the level is however sufficiently main- 
tained as can be seen by the fact that the population itself has a more healthy size. 

In order to understand the change mechanism in a bit more detail, a representative 
example run is also explained in depth. Figure 2.6 shows results of the performance 
on this typical run, also compared with a typical run without adaptation. Figure 
2.6A shows the overall population size over time. The population size of the simula- 
tion with adaptation remains relatively stable, whereas without adaptation it drops 
to a colony of size 3, which is equal to the number of larvae living without being 
fed. Figure 2.6B and C shows information regarding brood care: First, the aver- 
age pheromone level, which is the trigger to activate the allocation to brood carers. 
Furthermore, the number of active brood carers in the colony is shown. In the case 
with adaptation, their number increases significantly in the beginning of the simula- 
tion, as the amount of pheromones observed is relatively high. Therefore, a lot of the 
brood carer roles are allocated. For example, at time point 300, 15 out of a population 
of 28 are brood carers. 

Despite the fact that the overall pheromone level is not decreasing rapidly, the 
number of brood carer roles drops significantly after time point 300. This is due 
to the fact that member roles can only share an allocation with one worker role at 
a time. When another role receives a higher urgency (e.g., there is a huge attack, 
demanding many patrollers), a switch of worker role takes place. Figure 2.6D shows 
the number of worker roles of the different types (except the resting workers) within 
the bee colony for the setting with adaptation. The number of brood carers decreases 
after time point 300 due to an increase in the number of shared allocations to the 
undertaker and forager roles. This results in an increase in pheromone level again, 
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FIGURE 2.6 Results of simulating the bee colony with and without adaptation. (A) Shows 
the population time over time, (B) shows the relative larvae pheromone level, (C) the number 
of brood carers whereas (D) shows the number of workers of different types. Note that (D) 
only shows the worker types for the adaptive case. 


causing a higher delta for brood care again, resulting in more brood carers, etc. The 
pheromone level finally stabilizes around 0.5 in the organizational model with adap- 
tation. For the setting without adaptation, the brood carers simply cease to exist due 
to the fact that none of the larvae are growing up. The pheromone level stabilizes 
at a higher level. The properties from Section 2.3 have been checked by the auto- 
mated TTL checker using these representative example runs. With the following 
parameter settings, the properties were validated and confirmed for the organiza- 
tional model with adaptation and falsified for the one without adaptation: OP1(20), 
OP2(broodcare, 0, 0.9), OP3(broodcare, 0.15, 10,000), OP4(brood care, 0.3, 200). 


2.6 CONCLUDING REMARKS 


The organizational model for decentralized organizational change as seen in honey 
bee colonies has been formally specified by means of a methodology that describes 
the behavior of an organization on multiple aggregation levels [21]. The model is 
inspired by mechanisms observed in nature but is more general: these adaption 
algorithms can be very effective in many more types of applications; in Bonebeau 
and Theraulaz [10], examples of the effectiveness in other domains are provided. 
The model can therefore support organizational modelers and analysts working 
with multiagent organizations in highly dynamic environments, without a central 
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authority directing change, in general in designing and analyzing such an organiza- 
tion. In Hoogendoorn and Treur [22], a more generic approach toward modeling 
these decentralized adaptations is presented, in which the honey bee colony is used 
as an example to perform these decentralized cases. The formal specification of 
the behavior in the organizational model presented in this chapter is described by 
dynamic properties at different aggregation levels. Once the lowest level properties 
within the organization are specified in an executable form, the organizational model 
can be used for simulation abstracting from agents (to be) allocated. Such low-level 
properties can be indicative for the behavior of the agent allocated to that particular 
role. The possibility also exists to specify the role properties at the lowest aggrega- 
tion level in a more abstract manner, in a nonexecutable format. Hierarchical rela- 
tions between the properties can be identified to show that fulfillment of properties at 
a lower level entails the fulfillment of the higher level properties. Simulations using 
agents can be performed and checked for fulfillment of these properties. Properties 
for the behavior of roles regarding decentralized organizational change have been 
specified on an executable level to be able to perform simulation, and higher-level 
properties have been identified as well. The model has been evaluated by looking 
at an aggregate behavior over multiple runs (using certain parameter settings), but 
also by investigating in more detail a single run to understand the functioning of 
the mechanism itself. The results showed that, given the external circumstances, it 
was effective, given overall properties put forward by biological experts. Next to the 
domain of honey bee colonies, the formal approaches put forward in this chapter 
have also been used for modeling other biological processes, for instance, in Jonker 
et al. [23], a model of the living cell is presented. 
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ABSTRACT 


Early self-organizing models in biology tended to focus on the role played by self- 
organization alone and downplayed alternative pattern formation mechanisms. In 
this chapter, I use two examples of how self-organization is used by honey bees to 
illustrate when self-organization should be favored, or disfavored, relative to other 
pattern formation mechanisms in biological systems. First, I argue that composite 
patterns, those that are not one pattern, but actually many simple patterns superim- 
posed over one another in time or space, can have much simpler mechanistic bases 
than their overall complexity suggests. This means that simple templates and recipes 
can be important for generating such patterns. This is particularly true when patterns 
grow slowly in time and only become functional when they achieve a certain level 
of complexity. Second, I argue that processes in which information must be inte- 
grated across a large complicated system require coordination of action that can only 
be achieved via centralized or decentralized control structures (self-organization). 
Following Seeley, I argue that decentralized control evolves in contexts in which 
centralized control is prohibited by constraints or is not favored due to its lack of 
robustness in the face of perturbations to key components. When these are not true, 
centralized control should be favored as it leads to higher fitness. Accordingly, and 
contrary to some discussions of pattern formation in biology, centralized control 
(via nervous systems) is widespread in biology and both centralized and decentral- 
ized control are major principles in biological pattern formation. 


KEYWORDS 


Self-organization, Pattern formation, Templates, Recipes, Centralized control, 
Decentralized control, Agent-based modeling 


3.1 INTRODUCTION 


Pattern formation in biological systems is a rich subject that spans the development 
of organelles within the cell to the behavioral rules governing collective decision 
making in groups of animals [1-8]. While the mechanisms can be starkly different 
between contexts, there are common conceptual principles that span the diversity of 
biological pattern formation. Chief among these are the notions of self-organization, 
templates, and recipes (reviewed in [2]). Each plays a major role in biological pattern 
formation and each can operate at any biological level (from molecules to whole 
organisms). Self-organization refers to processes in which local interactions generate 
group-level behaviors that would be difficult to predict based on observations of the 
individual-level behavior alone [9—16]. In other words, they are processes in which 
a holistic approach (one at the group level) must follow a reductionistic description 
of the system. Examples include Benard convection cells in physics, the construc- 
tion of some organelles in cell biology, and the behavioral basis of most collective 
decision making in ants and bees [6,14,15,17—19]. Templates refer to patterns in the 
environment that contain information useful for an organism attempting to gener- 
ate a pattern [2,20—22]. Examples include the construction of some bird nests [2] 
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and part of the basis of nest construction in ants [20]. Simple gradients lain down 
by a source beyond the system are also sometimes considered templates (reviewed 
in [23]). Finally, recipes are cookbook procedures in which individual-level behav- 
lor gives rise to very predictable group-level patterns [2]. Examples include web 
building in spiders and nest construction in many wasps. 

The purpose of this work is to explore when the various forms of pattern forma- 
tion mechanism are likely to be used within biological systems and why. In general, 
I will argue that it is useful to distinguish between structure and process and between 
patterns that are composites of many simpler patterns and patterns that must be con- 
structed and function all at once. I will also discuss the varying information process- 
ing demands in each of these cases [24]. Since real pattern formation mechanisms 
tend to be highly complex, such that all the mechanisms are used at some point in 
the process, understanding the roles played by each mechanism involves explaining 
the general principles underlying when one mechanism is likely to be favored over 
another for a particular pattern formation task. I will illustrate such principles by 
reviewing two case histories of collective decision making in the honey bee. The 
first is one in which self-organization plays a vital, but relatively small, role [22], 
and the second is one in which self-organization is the primary pattern formation 
mechanism [25]. Hence, the first illustrates those cases in which self-organization is 
likely to be of little (or sometimes no) importance and the second illustrates a context 
in which self-organization is the only viable mechanism of pattern formation. I will 
conclude with a discussion that fleshes out how generally applicable those principles 
illustrated with collective decision making are to biology as a whole. 


3.2 CASE HISTORY 1: PATTERN FORMATION 
ON HONEY BEE COMBS 


Honey bee nests, like those of many insect societies, are large complex structures 
[20,21,26,27]. The insects that make these structures, in contrast, are small and have 
access to only limited information. How such creatures make such complex patterns 
has long fascinated biologists [17,28—30]. Because many solitary wasps and bees use 
rigid recipes to construct their nests, and because some insect nests contain gradi- 
ents that can be used as templates [20,21], this is a case where all three pattern for- 
mation mechanisms can operate [20—22,29,30]. In this section, we will first describe 
the nature of the pattern, before discussing a model for how it can be generated. I 
will argue that early self-organizing models, though seminal in their demonstra- 
tion of the importance of self-organization, were too simple to account for this case 
(and many other cases) of pattern formation. In contrast, I will argue that all three 
mechanisms (self-organization, templates, and recipes) work together in ways that 
can be demonstrated with simple models and likely in many other ways still beyond 
our understanding. 


3.2.1 NATURAL History OF THE PATTERN 


In many cases of pattern formation at the molecular level, we have only a very limited 
understanding of the full extent of the pattern. Pattern formation in developing 
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embryos, for example, is of such complexity that layers of the overall complexity 
are peeled away decade after decade. It is therefore an unfortunate reality that we do 
not know how well our models of such processes explain the totality of the pattern 
(reviewed in [23]). At the macroscopic level, however, it can be relatively straight- 
forward to describe the pattern in great detail. If this is done, then the explanatory 
power of a given model can be compared to the totality of the problem it attempts to 
solve. Hence, I will first go into some depth about the complexity of the pattern that 
will be modeled. As we will see, the pattern emerges over a long period of time, in 
response to many social needs and physical constraints. Further, the nature of the 
pattern at the end is radically different from that at the beginning, meaning that the 
nature of information present in the pattern changes over time. 

Honey bee nests are large three-dimensional structures built in the cavities of 
trees or sometimes under rock overhangs [26]. Figure 3.1 shows a typical honey bee 
nest. The nest has three major sections. There is a honey zone at the top where the 
bees keep their honey stores, a brood zone at the bottom where bees rear their young, 
and there is sometimes a band of pollen in between the brood and honey. Even when 
the band exists, however, there is considerable pollen stored throughout the brood 
zone. This is the basic pattern, but there are many critically important details. First, 
the cells at the top of the nest, at and near the attachment to the tree, are much thicker 
and more robust than the honeycomb elsewhere [26]. This is because the comb must 
support over 20 kg of weight with very thin wax, and hence the connection to the 
tree must be solid. Hence, the cells are deep at the top and taper off toward the base. 
Second, the queen leaves a pheromone trail wherever she goes [31], and because 
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FIGURE 3.1 Wild nest of the honey bee. (From Seeley, T.D. and Morse, R.A., Insectes Soc., 
23, 495, 1976.) 
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she rarely leaves the brood zone, this means this section of the nest has a chemical 
signature different from that of the honey zone. Further, when brood are present they 
also secrete a pheromone that contributes to the olfactory properties of the brood 
zone [32,33]. Third, when bees emerge from cells they leave behind their cocoons, 
which darken eventually to a black color. Successive rounds of brood rearing result 
in smaller cells, as old cocoons build up within the cells [26,32]. As such, the cells 
in the brood zone are often a different color and size and have different olfactory 
properties from those in other parts of the nest [34]. Finally, nectar foragers rarely 
leave the bottom portion of the nest called the dance floor. This is where nectar 
foragers unload their nectar loads to nectar receivers, who process the nectar into 
honey and store it elsewhere in the nest [35]. 

The importance of the preceding details regarding the nest is as follows. In a 
newly founded nest, there is only a small comb that has not been used for brood 
rearing, which contains very little food. Hence, there is no spatial information in the 
initial comb pattern. The mature nest, however, is full of information. The two major 
zones differ strongly in olfactory, physical, and social cues, all of which are easily 
discernible to the sensory system of the bee. In short, the honey bee nest pattern is 
highly complex with many adaptive functions that evolve over time. The totality of 
this pattern is still beyond current models to explain. The goal here therefore is not 
to explain the entire pattern but to show that all three pattern formation mechanisms 
(templates, recipes, and self-organization) are important for its construction. 


3.2.2 AGENT-BASED MODEL OF PATTERN FORMATION ON Honey Bee Comes 


The model presented here builds on a previous model by Camazine [36]. Camazine 
described the honey bee pattern as concentric with honey on the outside, pollen in 
an intermediate band, and brood in the center. As reviewed in the preceding discus- 
sion, this is not the case, but it does capture part of the pattern. Camazine’s self- 
organizing model had three simple rules: (1) the queen lays eggs in the center of the 
comb, (2) workers deposit nectar and pollen at random, and (3) bees preferentially 
remove pollen and nectar from near the brood. I made the following changes based 
on experimental evidence: (1) bees preferentially unload pollen next to open brood 
[37] and (2) bees have an upward bias in their movement pattern as they look for a 
place to unload nectar [35]. The first rule is a template effect as the brood provides 
positional information for unloading the pollen and the second is a recipe effect, in 
that a bias in the upward direction will naturally cause more honey to be unloaded 
at the top of the nest. 

The model was implemented in the Netlogo agent-based modeling environment 
[38]. The nest surface was modeled as 14,025 cells arranged in a rectangular shape 
(similar to that of a natural bee nest). Four types of bees were modeled: a queen, 
pollen foragers, nectar receivers, and nurses. All parameter levels were consistent 
with studies of honey bee foraging and feeding rates [22]. Queen behavior was mod- 
eled after studies by Camazine [36]. Queens lay up to | egg/min in cells within four 
cells of another brood cell. They begin laying in the center of the nest (filling it to 
80% full) before searching the rest of the nest for places to unload. Queens also avoid 
the nectar zone, with the simple rule that if more than 20 consecutive steps are taken 


50 In Silico Bees 


on honey cells, then the queen increases her speed in a random direction until she 
finds the brood zone again. This is to mimic the fact that queens spend most of their 
time in the brood zone. Pollen foragers begin at the entrance of the nest and conduct 
a random search for an open brood cell. Once they find one, they unload into the first 
empty cell they find near it [37]. If they are unable to locate an open brood cell after 
a set period of time, they unload at random. Because honey bees regulate the amount 
of pollen they collect, a simple feedback loop was used to regulate pollen foraging. 
If less than 1096 of the cells in the nest contain pollen, then pollen foragers forage 
at their maximum rate (set to 80% of the nectar foraging rate). If more than 10% of 
the cells contain pollen, then only 1046 of the pollen foragers forage. This feedback 
mechanism is somewhat arbitrary; however, it leads to the accumulation of pollen 
stores that are sufficient to last for about 3 days, which is the typical amount found 
in honey bee nests [39,40]. Nectar receivers receive nectar at random locations along 
the bottom of the nest and then walk up a variable distance before looking for a place 
to unload. If receivers are unsuccessful at finding a place to unload after their first 
upward walk, they repeat the process until they are successful or until they reach 
the top of the nest at which point they begin a random search until successful. This 
behavior was modeled after Seeley's observations of nectar receivers [35]. Rate of 
nectar collection was set to 30 bees/min, the rate observed in a study of a colony of 
the same size modeled [45]. Overall, 1,800 nectar receivers unloaded honey into cells 
per hour. Nurse bees remove (eat) pollen and nectar from near the brood (in order 
to produce brood food) according to a simple rule. Each nurse conducts a random 
search for a pollen cell beginning at a random location within the brood zone. Hence, 
nurses search first within the brood zone for food, before searching around it. The 
search is simply a random walk in which the nurses inspect cells as they walk about 
until they find pollen. This creates differential rates of removal of food from near the 
brood. A more complete description of the model is available in Johnson [22]. 


3.2.3 Nest PATTERN RESULTS 


Figure 3.2 shows the emergence of the pattern. Initially, the queen lays eggs in the 
center of the nest, which ultimately results in a compact central brood zone. Pollen 
is initially unloaded at random because there is no open brood to use as a template 
(the queen lays eggs that take 3 days to hatch). Nectar shows a bias toward the top 
of the nest, the strength of which varies with the distance receivers walk upward 
before looking for a place to unload. In the early phases of pattern formation, there 
is considerable honey stored at the bottom of the nest and all around the brood. By 
day 4 (the timing of each of these phases depends on the parameterization of the 
model), the top of the nest is solidly full of nectar and pollen. The queen, who has 
no bias toward the top or the bottom of the nest, is only able to find places to lay in 
the bottom of the nest, which begins to fill with brood. Pollen begins to accumulate 
throughout the brood zone at this point (because eggs are hatching into open brood) 
with a strong bias toward the bottom of the nest because pollen foragers unload next 
to the first open brood cell they find. By day 7, the bottom of the nest is mostly full 
of brood and pollen and the queen is only able to occasionally lay eggs (as cells are 
emptied by nurses). By day 14, the pattern is fully present. Although the pollen band 
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Day 1 Day 4 Day 7 Day 10 Day 12 Day 14 


FIGURE 3.2 (See color insert.) Agent-based model of pattern formation during a period 
of high nectar intake. Honey cells are yellow, pollen cells are red, and brood cells are black. 
Initially, pollen is scattered throughout the nest, but once open brood is present, pollen accu- 
mulates at the bottom of the nest. Nectar shows an immediate bias toward being unloaded at 
the top of the nest due to the upward movement of nectar receivers. By day 7, the complete 
pattern is almost present with the exception of the pollen band, which forms by day 14. (From 
Johnson, B.R., Proc. Roy. Soc. B Biol. Sci., 276, 255, 2009.) 


between the honey and brood is not as strong as initially described by Camazine 
[36], this band is only sometimes seen in real colonies, and large sections of pollen 
within the brood zone are common in real nests. Although I will not discuss it here, it 
is also the case that fluctuations in the availability of food (due to bouts of rain during 
which bees continue to eat but do not forage) can create a strong pollen band between 
the honey and brood [22]. 

Figure 3.3 sheds light on the mechanisms underlying the pattern shown in 
Figure 3.2. It shows the final pattern for runs of the model with varying combi- 
nations of behavioral rules. Figure 3.3a shows the full model (with rainy days, 
which improves the clarity of the pattern). Figure 3.3b shows the effect of remov- 
ing the template used by pollen foragers (unloading near open brood). In this case, 
pollen stays scattered throughout the honey zone. This simple template therefore 
greatly improves the clustering of pollen near the brood (where it will ultimately 
be used). Figure 3.3c shows the effect of differential removal of food (honey and 
pollen) from near the brood. As Camazine [36] showed, the effect of this is to 
create an open band between the brood and honey, which is then filled with pollen 
(which has a faster turnover rate than honey and for which there are fewer places 
to unload outside of the open band). It also helps divide the honey and brood zones 
into distinct sections, as the differential removal ensures that all the cells in the 
brood zone are eventually filled with brood (and not honey). A solid brood zone 
is important because it facilitates thermoregulation of the brood, which must be 
kept at 33°C-36°C [41,42]. Figure 3.3d shows the effect of removing the recipe 
of upward movement during unloading of nectar. In this case, the vertical pattern 
does not form. In nature, the vertical pattern is important, because approximately 
20 kg of honey must be stored in the nest, and storing this material at the top of the 
nest, in the thickest, most robust cells, is necessary. It is also necessary to have the 
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FIGURE 3.3 (See color insert.) Contrasting roles played by each mechanism underlying pat- 
tern formation. The pattern is shown at 14 days in each image. (a) The full model. (b) Without 
the queen-based template for unloading pollen near open brood, pollen is scattered throughout 
the honey zone. (c) Without differential removal of food from near the brood (the SO mecha- 
nism), the pattern is far from complete in that pollen does not localize and the sections of the 
nest are not distinct. (d) Without the recipe's effect of upward bias in unloading of nectar, the 
pattern is not vertical (honey on top brood on the bottom). (e) The original self-organization 
model of Camazine (differential removal of food from near brood alone) does not lead to com- 
plete pattern formation. (From Johnson, B.R., Proc. Roy. Soc. B Biol. Sci, 276, 255, 2009.) 


honey zone as one compact region, since during winter when bees consume it, they 
must be able to move up a contiguous region of honey. Finally, Figure 3.3e shows 
Camazine's [36] original model without the additional template or recipe. Here, 
there is not a vertical pattern but only a very faint pollen band. It is possible to 
create a larger pollen band by tuning the parameters, but it is not possible to local- 
ize most of the pollen near the brood if bees store stockpiles of pollen sufficient to 
last them a few days without forage. 

Figures 3.2 and 3.3 are about the mechanisms of pattern formation, the how ques- 
tions. Now we switch gears to try to illuminate the why question. In other words, 
why might it be selectively advantageous to use a mechanism like the one the bees 
use? Figure 3.4 shows the growth rates of colonies that vary in the degree of upward 
bias shown by the receivers as they walk up looking for a place to unload nectar. 
Essentially, the larger the bias in unloading toward the top, the higher the growth rate 
of the colony. The reason is quite intuitive. If there is little or no bias in the deposition 
of nectar, then the whole nest quickly gets blanketed in a light layer of honey and 
there is no place for the queen to lay eggs. If the nectar foraging rate is high enough, 
then this light layer can become a thick layer and the queen gets boxed into a small 
central brood zone (which grows slowly as food is eaten away at its edges). If, how- 
ever, the bees bias their deposition upward, then cells are left open for egg laying. At 
the extreme, if the entire bottom is left often, then the queen is unhindered as she lays 
and the growth rate is maximized. However, since a compact brood zone is useful, 
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FIGURE 3.4 Exploration of the adaptive benefits of using a recipe for generating the pattern 
on the honey bee comb. The different lines represent different degrees of upward bias (in per- 
cent of the nest the receiver walks up before trying to unload nectar). Colonies have a higher 
growth rate when bees have a strong upward bias in deposition of nectar. This is because if 
nectar is unloaded at random, then it coats the nest and blocks the queen from laying eggs. 
(From Johnson, B.R., Proc. Roy. Soc. B-Biol. Sci., 276, 255, 2009.) 


it is probably an intermediate level of open space for egg laying that is best, and 
hence a moderate amount of bias upward during unloading may be favored. 


3.3 CASE HISTORY 2: TASK ALLOCATION IN 
MIDDLE AGE HONEY BEES 


Task allocation is the study of how colonies allocate the correct number of individuals 
to tasks that change in location and demand [43—45]. It is an intriguing problem 
because workers tend to only have access to local information, yet the demand and 
locations of tasks change at a much larger global level. Honey bee foragers, for exam- 
ple, visit flowers within 12 km of their nest and optimally allocate themselves to 
flower patches within this area [46]. They accomplish this feat by sharing informa- 
tion with the waggle dance, which can be used to indicate the location of a food site 
and can be modulated such that a good site is more heavily danced for than a lesser 
site [35]. Ants likewise allocate themselves to food sources located over an immense 
area (relative to the size of an ant) using communication systems dependent on sig- 
nals, pheromone trails [13,47]. Task allocation in the middle age caste of honey bees 
(MABs) presents a particularly interesting question of optimal allocation of workers 
to tasks, because these bees, unlike the foragers, do not make use of signals [45]. 
Hence, they do not encode their sense of the need or value of a particular task into a 
signal that is then used to generate a collective decision. 
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To explore how MABs solve their task allocation problem, I employed a classic 
experimental and theoretical approach. I first described the pattern (at the individual 
and group levels), and then I used these data to construct an individual-oriented 
model to explore how these bees allocate themselves to tasks. 


3.3.1 EXPERIMENTAL PATTERNS 


MABS do all the work within the nest except for brood care [48—50]. This encom- 
passes building the nest, maintaining and repairing it, processing nectar into honey, 
and guarding the nest, to just name a part of their task repertoire. In all, they do 
about 18 different tasks spread across the nest. Given that a nest is vast compared to 
the size of a single bee, it is clear that task demand is changing over a spatial scale far 
too large for a bee to have immediate direct experience of changes in task demand at 
the global level. Two data sets provided the key to how bees might collectively solve 
this problem. These data focus on the nature of task switching and individual-level 
movement patterns. 

Figure 3.5 shows the hourly behavioral state (task) of a group of 47 bees, all of 
whom were observed working wax at time period one [45]. It was discovered that 
after a single hour, the rate of wax working in this group had fallen down to nearly 
the background level of wax working for the whole caste [45]. In addition, 1 h after 
being observed working wax, many bees were either searching for new work or had 
switched tasks. This data set matched somewhat the early reports of Lindauer [51] who 
watched a single bee for its whole lifetime and found that the bee was a generalist who 
would perform nearly any task within a short period of time. Johnson [45] confirmed 
that bees are generalists for tasks within their task repertoire, but he did not confirm 
whether they would perform any task (e.g., they do not perform nursing tasks). 

Figure 3.6 shows the path of a bee conducting a patrol [49]. Patrols are long, 
seemingly random, walks through the nest [49—51]. Over the course of observing 
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FIGURE 3.5 Hourly scans of 47 MABs observed working wax at time period one. After a 
single hour, wax working fell to nearly the background rate, suggesting most bees in the MAB 
caste are generalists who switch tasks often. (From Johnson, B.R., Behav. Ecol. Sociobiol., 
51, 188, 2002.) 
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100 cm 


FIGURE 3.6 Path of a MAB on patrol. The grid represents a grid drawn on the surface 
of a four-frame observation hive in which marked bees are being observed. Each black grid 
cell is a cell the bee visited during a 30 min period of observation. This bee was observed 
to quit working at the top of the nest and then walk down a meandering path to the bot- 
tom. Such patrols were found to be common in this caste of bees. (From Johnson, B.R., 
Naturwissenschaften, 95, 523, 2008.) 


50 bees for 30 min using focal animal observations, it was found that nearly all 
MABS conduct patrols and that patrols cover 60 cm (total displacement) on average 
[49]. To illustrate the importance of this movement behavior, consider Figure 3.1, 
which shows the honey bee nest. The nest has a strong spatial structure, with dif- 
ferent tasks being conducted in different regions. If one considers this in light of 
Figure 3.6, then it is clear that after a long patrol a bee has changed to a location with 
a new set of tasks. The honey zone, the brood zone, and the dance floor (where nectar 
is unloaded), in particular, are areas in which different tasks with strongly variable 
demands are performed. 

To review the experimental work, it is likely that after a patrol a bee that begins 
to search for work will find a new task, contributing to the task switching patterns 
found in Figure 3.5. This suggests a simple self-organizing model for how the MABs 
can allocate themselves to variable tasks over a large area. 


3.3.2 MopEtEL 


An agent-based model was constructed to determine if the simple behaviors recorded 
in Figures 3.5 and 3.6 are sufficient to explain MAB task allocation [25,38]. Like 
most agent-based models, the model has a landscape and a variable number of agents 
who interact with one another and with the patches. The landscape of the present 
model has three work zones (the honey zone, the brood zone, and the dance floor). 
Each zone is composed of patches on which one type of work is conducted. Each 
patch has a stimulus level that corresponds to the amount of work available there. If 
the stimulus is five, for example, then when a worker finds work on that patch, the 
stimulus falls to four until the worker quits working. The nest surface overall had 528 
patches. The number of patches of each type was varied depending on the simulation 
(details in the results section). 

The simulated bees are autonomous agents that interact with the patches but not 
with each other. That is to say, they only effect one another's behavior through their 
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FIGURE 3.7 Flow diagram of the behavioral rules governing worker behavior in the model 
for task allocation in MABs. (From Johnson, B.R., Am. Nat., 174, 537, 2009.) Workers can 
be in one of three behavioral states: working, patrolling, or inactive. Working bees conduct 
a simple search for work, patrollers conduct a correlated random walk, and inactive bees are 
simply inactive. 


interactions with the patches. With respect to movement, they move over the land- 
scape according to a step length that is independent of patches. That is to say, work- 
ers do not jump from patch to patch but take a step that may or may not cause them 
to leave a patch in one time step. Figure 3.7 shows the simple behavioral algorithm 
used by workers based on experimental data. Bees can be in one of three behavioral 
states at a given period of time: working, patrolling, or inactive [49]. Each time step 
(10 s), a worker either stays in its current state or switches to another (choosing at 
random) based on a quitting probability parameterized with the data collected in 
the experimental studies [49]. While in the working behavioral state, bees conduct a 
random search for work. This means they perform a random walk during which they 
periodically stop to check if work is available on the patch they are currently within. 
If so, they take up work there and stay. If not, they move on. If a worker starts to work 
on a patch, the stimulus level on that patch falls by one and stays at that level until 
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the worker quits the working state, at which point it increases by one. Patrolling bees 
conduct a continuous correlated random walk until they switch to another behavioral 
state. Patrolling bees do not inspect cells or interact with the nest in any way. Inactive 
bees are simply stationary and do nothing until they quit their state. 

The model was parameterized as follows. Patrollers move at a rate of 3.15 cm/min 
(net displacement). This means a step length of 1.5 patches per time step with succes- 
sive turn angles within a 180? arch. Bees searching for work had a step length of 0.95 
patches per time step. Working bees had a quitting probability of 1/1,800 s, inactive 
bees one of 1/1,000 s, and patrollers one of 1/800 s. This distribution gave a ratio 
of workers in these states that matches those found in experimental studies [45,49]. 


3.3.3 RESULTS 


Model validation, comparing the models’ output to real data, was performed success- 
fully, and the results are available in Johnson [25]. Here, I focus on the nuts and bolts 
of how the model works. Figure 3.8 shows the basic behavior of the model. For the 
first day of this simulation, the stimulus levels for each task were fixed, and the model 
quickly produced an allocation of workers to tasks that matched the variation in stimu- 
lus levels (task 1 had the highest stimulus level and task 2 the lowest). When I simulated 
a change in the environment, such that the demand for one task rapidly fell off and that 
for the other two increased, there was a rapid response by the bees and a new pattern of 
labor allocation appeared. Hence, the model is able to solve the sort of task allocation 
problems faced by MABs; that is, it can allocate bees to tasks that unpredictably change 
in demand over a large area. We now explore how the model accomplishes this feat. 
The model functions by coupling two opposing forces (Figure 3.9). Figure 3.9a 
illustrates the first, which is a localizing mechanism. This is the result of the random 
search for work that workers perform when in the working state. This serves to localize 
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FIGURE 3.8 Output from the model of task allocation in MABs. Shown are the numbers of 
bees working on three tasks with different levels of demand (stimulus levels). Stimulus levels 
are held constant for the first day and a stable allocation of workers to tasks that matches 
variation in demand is achieved. After a change in the environment at 24 h, the model quickly 
reallocates bees to tasks in accordance with the new ratios of stimulus levels. (From Johnson, 
B.R., Am. Nat., 174, 537, 2009.) 
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FIGURE 3.9 Two mechanisms underlie task allocation in MABs. In each simulation, work 
is only available at the top of the nest (zero stimulus levels elsewhere). In the beginning of 
each simulation, bees are at the center of the nest. (a) Bees search for work but do not conduct 
patrols. (b) Bees patrol but do not search for work. Searching for work localizes bees to tasks, 
while patrolling randomizes worker location over the surface of the nest. (From Johnson, 
B.R., Am. Nat., 174, 537, 2009.) 


Workers in accordance with variation in task demand. Figure 3.9b illustrates the oppos- 
ing force, which is the result of patrolling behavior. Patrolling serves to randomize 
worker location without reference to variation in task demand. Hence, it causes a con- 
stant rate of diffusion away from regions of high workload to regions of low workload 
in a constant environment. Figure 3.10 shows how the two forces work together to 
balance productivity and flexibility. Productivity is a measure of how many workers 
have been assigned tasks (how much work is being produced), while flexibility refers 
to how quickly workers can reallocate themselves after a change in the environment 
that necessitates a shift in labor allocation. Figure 3.10a shows a situation with low 
productivity, but high flexibility, while Figure 3.10c shows the opposite. What differs 
between these figures is the ratio of time spent patrolling to working (or localizing to 
diffusing). When workers spend a large amount of time in the working state, and little 
in the patrolling state, they have high productivity but low flexibility and vice versa 
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FIGURE 3.10 (a) Optimizing productivity and flexibility in task allocation. Simulations are 
shown in which variable ratios of time are spent in the working and patrolling states. (b) High 
rates of working lead to high productivity but low flexibility, while high rates of patrolling 
lead to high flexibility but low productivity. (c) An optimal balance between the two forces 
allows a colony to maximize productivity without compromising flexibility in the face of a 
variable environment. (From Johnson, B.R., Am. Nat., 174, 537, 2009.) 


when the ratio is the opposite. Hence, there is an optimal balance between the time 
spent localizing to tasks and diffusing over the surface of the nest that maximizes pro- 
ductivity without compromising flexibility (for a given set of parameter values). 


3.4 DISCUSSION AND CONCLUSIONS 


3.4.1 Case History 1: COMPOSITE PATTERNS 


The pattern on the surface of a honeycomb evolves slowly over time according to 
many rules. Unlike in the simplified simulations, the real pattern starts small and 
grows in three dimensions. As the comb ages, different portions of the nest take on 
new forms (old versus new comb), and the workers modulate their behavior based 
on this information [32]. Therefore, a pattern emerges slowly over time according to 
many rules, some of which interact, some of which do not, and some of which only 
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appear at certain stages of development. In such cases, the pattern is not one pattern 
at all, but many patterns superimposed over one another in time and/or space. Such 
composite patterns are highly complicated structures that may or may not need self- 
organizing principles for their construction. 

A composite pattern that is the result of many simple patterns superimposed over 
one another can have a simple explanation that is amenable to a reductionist approach. 
It can be the case that each pattern is the result of simple template effects and that 
a recipe-type program controls when each template is used. "Recipe" is a term for 
an inflexible cookbook set of instructions that are carried out in a sequence with no 
feedback between the different steps. A treasure map, for example, is a recipe. The 
searcher does not reference any positional information as it moves; it simply walks 
according to instructions. Any errors in the implementation of instructions cannot 
be corrected with external information, and small errors early in the process can 
completely negate the possibility of ultimate success. This sort of process with zero 
feedback or interaction is not self-organization. It can be useful for solving many 
problems in biology, however, if the initial state can be precisely defined (analogous 
to starting in the right spot in the context of the treasure map) and/or a fixed sequence 
of events can get the system from one state to another. 

An example will be useful to illustrate how composite patterns could be formed 
with or without the use of self-organization. This example is loosely based on 
embryogenesis in Drosophila [23,52—55] but is not meant to be a literal discussion 
of the topic. If we imagine an egg with a set of gradients imposed on the system by 
the mother, then the initial conditions are anything but random. They are in fact 
precisely initialized by an external agent. Hence, at the start of the process there are 
templates (externally imposed gradients of chemicals that can provide information 
about position within the system) that have a precise relationship to one another. 
If all that happens after this is that the templates are used to turn on different genes 
according to a combinatorial relationship between concentration gradients, then the 
ultimate pattern that forms is based on many simple template effects superimposed 
in time and space. If the initial phases of gene expression trigger downstream cas- 
cades that are entirely fixed processes with no feedback, then a recipe provides the 
control for the process. This should be true no matter how many steps there are in the 
recipe, as long as there is no interaction between template mechanisms. (Many rules 
can be used at once or different rules can be used at different times, but no coordina- 
tion between them occurs.) 

If such a recipe making use of templates was all that occurred in development, 
then self-organization would likely not play much of a role. However, development 
is mainly about the differential growth of separate components of the system such 
that a complex three-dimensional structure is formed [56—59]. To the extent that 
differential growth within the embryo requires coordination (or responsive control) 
in order for pieces that are initially apart to come together or to take particular spa- 
tial relationships to one another, simple templates and recipes are not sufficient to 
explain these cases of pattern formation. Further, it is easy to imagine how templates 
can coordinate pattern formation within fixed space if the system is not growing, 
but a more dynamic changing pattern is difficult to reconcile with a recipe and tem- 
plate basis. This is because small errors early in the process would not be buffered 
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to produce a robust mechanism. Hence, for dynamic patterns, particularly those 
that require coordination between elements, some mechanism that is interactive is 
necessary. As Turing pointed out in his now classic paper, the reaction diffusion 
mechanism [9] is one such mechanism for generating differential growth. It does 
not necessarily apply to every pattern formation situation, but some such Turing-like 
process is often at play when coordination between growing structures is necessary 
at the molecular level [3,23,56—60]. Self-organization can even be necessary when 
pattern formation occurs in a fixed space, if shifts of pattern are necessary relative 
to the initial concentration gradients, or if robustness is necessary in the context of 
imprecise gradients (reviewed in [23]). 

In general, it is likely that just as the honey bee pattern we explored is based on 
a combination of pattern formation mechanisms, so are other composite patterns in 
biology. Given the large number of changes in conformation requiring sophisticated 
coordination that occur in developmental biology, it may well be the case that self- 
organizing processes are the most common pattern formation mechanisms in that 
context. However, this should be taken with two strong caveats. First, templates are 
easy to lay down within a subsystem by elements of the larger whole system (e.g., 
the mother). Templates should therefore play a large role whenever pattern formation 
problems are solvable with such mechanisms (i.e., when they occur in a fixed vol- 
ume and can be based on simple concentrate gradients). Second, the steps of a recipe 
can be any type of mechanism. Hence, if the pattern formation process depends on 
first laying down a grid on the surface and then growing differentially into a new 
three-dimensional structure, then one recipe can control the entire process. AII that 
is required is that at the end of each step there is an indicator that is used to trig- 
ger cessation of the current step and initiation of the next. Each step can either be 
based on templates or some form of self-organizing process. In general, genetically 
based recipes in which the steps are mostly self-organizing, but with significant 
use of templates, is a good null hypothesis for how pattern formation of composite 
structures occurs. 


3.4.2 Case History 2: PROCESSES THAT INTEGRATE INFORMATION IN TIME 


Unlike the case for a pattern that emerges slowly over time and/or space and only 
eventually takes on some function (like many structures used for support or pro- 
tection), some patterns reflect optimal solutions to current problems. In the case 
of the MABs trying to optimally allocate themselves to tasks, the goal is to find 
the current best allocation of workers to tasks given the state of the environment. 
Information from all relevant sources must be used and a fast and accurate response 
must ensue [7,43]. Hence, the pattern is complex; it emerges quickly and is func- 
tional immediately. There are two mechanisms used in biological systems for solv- 
ing this type of problem: centralized organization and decentralized control or 
self-organization [24]. 

It is worthwhile to illustrate the difference between the two mechanisms by 
describing a hypothetical situation facing a factory at which people are assigned to 
many jobs that can rise and fall in demand. The way a centralized control structure 
solves this problem is for managers to collect information from each sector of the 
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factory and integrate this information with the overall needs of the factory before 
assigning individual to tasks. As such, when 20 more workers are necessary for 
a job, they are taken from other sectors that are less important or overstaffed. If 
we imagine a hypothetical decentralized control structure inspired by social insects 
instead, it might look something like the following. Each hour a worker draws a ran- 
dom number (1—100) from a hat. If the number is less than 10, then that worker quits 
his or her current job and chooses a new job within the factory at random. If that 
job does not need more workers, then they choose again at random until they find 
one that does. In this case, when the demand for a job suddenly rises, it will attract 
more workers because all those workers who choose that job will find work there 
and stay, while for many other jobs the workers will not find work there and need to 
choose again. Ultimately, labor would be allocated according to work demand, but 
some labor would be wasted by individuals inefficiently looking for work at random 
according to the lottery process. In order for this to work, it is also necessary that the 
ratio of workers to total work is appropriate, because if there is infinite work avail- 
able for each job, then workers will not be assigned to tasks with respect to variation 
in demand. This hypothetical example is quite close to what the MABs are faced 
with and how they use decentralized control to solve their task allocation problem. 

The hypothetical example illustrates the basic difference between centralized and 
decentralized control. In centralized control, efficient decisions are made by man- 
agers with the ability to integrate large amounts of information. For decentralized 
control, a simple rule of thumb accomplishes the same result, but with a cost in inef- 
ficiency. Bees are unlikely to be able to process all the information that would be 
necessary to direct one another to tasks in an efficient directed manner, and, hence, 
they make do with a simple, robust, though inefficient, algorithm. Of course, such 
mechanisms can be made increasingly efficient by adding to the rules (such that 
tasks are not chosen at random, e.g., but with some bias toward important tasks or 
those that tend to change in demand most), but it is unlikely they can ever reach the 
efficiency of a well-orchestrated system of centralized control. 

In biological systems, centralized control is implemented quite commonly within 
the bodies of metazoan animals. Here the brain is a central processor, which takes 
in information from throughout the system, integrates it, compares it to global needs 
and goals, and makes decisions that are sent back out into the system. As one looks 
across the diversity of animals, there is a clear trend toward the most sophisticated 
organisms having central processors of increasing complexity. This pattern is so 
striking and obvious that a strong explanation for why animals should ever use 
decentralized control is necessary. 

A simple hypothesis for when animals should use centralized versus decentral- 
ized control was proposed by Seeley [24]. Simply put, animals use decentralized con- 
trol when either the evolution of centralized control is prevented by strong constraints 
or decentralized control confers higher fitness. Constraints can take many forms. 
Chiefly, centralized control may be nearly impossible to implement given the physi- 
cal character of the system. Contrast the nature of a nervous system, for example, 
with the internal dynamics of cell biology, which depend on collisions facilitated by 
molecular crowding [61,62]. It is difficult to imagine that a well-ordered system, like 
the nervous system, could be implemented within a cell no matter what the selective 
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pressure. It is no surprise then that cell biology seems to be the branch of biology in 
which self-organization plays the largest role. With respect to when decentralized 
control confers higher fitness than centralized control, centralized control is power- 
fully efficient and accurate but costly in terms of metabolic power and risky in terms 
of not being robust in the case of damage to the central processor. Decentralized con- 
trol is less efficient and accurate, but it is robust to damage to any part of the system 
and is cheap to implement in metabolic terms. In addition, for centralized control to 
work well, much information must be collected and transmitted quickly to a central 
organizer. If the scope of the problem is vast, compared to the information processing 
capability of the individuals, then this may be impossible. Both of these contexts are 
important in social insect biology, for example, where any insect (even the queen) is 
likely to be killed and in which workers have limited information processing capabil- 
ities relative to the scope of the problems they must solve. Beyond the social insects, 
it is also the case that decentralized control may be favored because the loss of effi- 
ciency with decentralized control is less than the cost of managers with centralized 
control. Given that managers do no work other than to direct others and can be hugely 
costly to produce and maintain, it is likely that this selective context exists for some 
human social organizations (even if action is rarely taken as a result of it). 
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ABSTRACT 


Honey bee foragers recruit other bees to visit productive patches of flowers by 
advertising, on their return to the hive, their source of nectar or pollen by a waggle 
dance to indicate the location and quality of the source. The distribution of foragers 
among sources, generated by this waggle dance recruitment, has been modeled with 
differential equations. Differential equation models either represent each stage of 
foraging—dancing, visiting forage sites, waiting as an unemployed forager, following 
a dance—or more simply divide the foraging force into pools of workers where each 
pool exploits a different site. Other models include receiver bees who work in the hive 
and modulate the foragers’ dance response to the quality of forage sites. Simulation 
and individual-oriented models for honey bee foraging are briefly discussed as well 
as foraging in other social insects. A brief description of the application of ideas from 
honey bee foraging to create bee-based computer algorithms concludes the chapter. 
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431 INTRODUCTION 


The effectiveness of food collection by workers in social insect colonies is one of 
the key determinants of whether a colony will thrive or die. Foraging will be most 
efficient if workers forage at easily accessible food sources that are rich in required 
nutrients. Honey bees forage in landscapes that provide flower patches of variable 
nutritional quality, of variable accessibility, both in terms of distance from the nest 
and ease of exploitation and of variable availability; many flowers only provide nec- 
tar and pollen at certain times of the day or they may be made unavailable to foragers 
by the presence of predators. The task of the hive is to find resources and optimize 
resource use by scouting, by dance communication, and by intercaste communica- 
tion inside the hive. 

In this chapter, we examine models for how the hive allocates its available for- 
agers among known patches of flowers. We will principally focus on differential 
equation models for forager allocation, but we will also mention a variety of other 
types of model. We will conclude by briefly reviewing how honey bees' strategies for 
optimizing food collection have inspired computer algorithms. 


4.2 BIOLOGY OF HONEY BEE FORAGING 


Honey bee colonies forage for nectar, pollen, water, and substrates for building inter- 
nal structures in the hive. There is evidence that different bees may specialize in 
foraging for one or more of these substances. This may be genetically programmed 
or due to the past experience of the individual. Here, we shall concentrate on nectar 
foraging; this has been well studied as it is easy to observe, and nectar foraging can 
be manipulated or imitated by providing feeders for bees that are stocked with sugar 
syrup. 

Individual foragers leave the hive to scout for a flower patch that provides suit- 
able nectar. Once a bee finds a suitable patch of flowers, she returns to the hive, 
and if the forage source provides sufficiently high-quality nectar and there is a 
need for nectar in the hive, then she will perform a waggle dance on the comb near 
the entrance of the hive to communicate the location and quality of the source that 
she has found (see Seeley [1] for a more complete description). A waggle dance 
consists of a number of waggle runs. In each waggle run, the dancer runs forward, 
rapidly waggling her abdomen from side to side. At the end of the run, she turns 
either to the left or to the right and returns to the start of the run and repeats the 
process. Usually the dancer turns left and right alternately at the end of each run 
so that the whole dance traces out a figure-of-eight pattern. The length of the 
waggle run indicates the distance of the forage source from the hive, and the angle 
between the waggle run and the vertical indicates the direction of the source rela- 
tive to the sun [2]. 
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Potential foragers may follow the dancer as she advertises the source that she has 
found. They follow close behind her and may follow for several cycles. Sometimes 
several potential foragers may be following a dancer at once, but it is not clear that 
they can all gather the dance information at the same time. 

A bee that has become an active forager through following a dance leaves the 
hive to seek the advertised forage source. As well as the information from the dance, 
she may also use the scent from the flowers that the dancer has been visiting to find 
the advertised forage source. On her return to the hive, she may also advertise the source 
by waggle dancing or she may continue to forage without dancing or cease to forage. 

Whether or not a returning forager performs a waggle dance depends not only on 
her assessment of the profitability of the nectar source that she is visiting but also 
on whether she is able to rapidly unload the nectar that she gathers. Receiver bees, 
who work in the hive, collect nectar from incoming foragers and take it to the comb 
where it is stored and concentrated to become honey. If a forager has to wait for an 
extended time to unload her nectar, then she is less likely to dance before returning 
to the forage sources [3]. 

Foragers who encounter a predator, overcrowded forage sources, or the presence 
of an alarm signal may produce a stop signal at the hive. They apply this signal to 
other foragers who are foraging at nectar sources that carry the same scent [4,5]. 
This stop signal is produced by the forager butting her head against the bee that she 
is communicating with and making a short buzzing noise. The recipient of the sig- 
nal is unlikely to continue dancing and so the dangerous source is not advertised as 
much and the number of foragers that visit it may decline. 


4.3 SCALE AND TYPE OF MODELS 


Social insects typically exist at intermediate scales. Depending on the behavior that 
is being modeled, a colony of bees can be regarded as a varying density of bees that 
can be modeled with differential equations, as a probability distribution, as undergo- 
ing a stochastic process, or as a number of discrete individuals that interact with one 
another according to predetermined rules. Most models for foraging fall into the 
large-scale category, which uses ordinary differential equations [6], or the small scale, 
which uses simulations of individual bees [7]. Models at different scales have differ- 
ent strengths and will give different types of insight into foraging and so different 
types of models have the capacity to inform and illuminate each other, although this 
has been more evident in models for nest site selection [8] than models for foraging. 

In this chapter, we focus on differential equation models for honey bee foraging— 
these are principally concerned with communication by waggle dancing—but we 
will also refer to simulation models as appropriate. 


4.4 FUNDAMENTAL MODEL: LINKING INDIVIDUAL 
AND COLLECTIVE BEHAVIOR 
How does a colony of several thousand bees ensure that it is exploiting the best avail- 


able forage sources and not spending undue time on poor sources? In fact, before this 
question can be answered, it is important to know how an individual bee assesses the 
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quality of a source and whether that assessment is done by foragers or by receiver 
bees or by some other mechanism. Experiments by Seeley et al. [9] showed that 
foragers assess the quality of a source based on both the sugar concentration in the 
nectar and the distance of the source from the nest. Other factors such as crowding at 
the source and ease-of-access to nectar in the flowers may also be relevant, but their 
experiments did not consider this. 

Further, Seeley et al. [9] showed that the number of waggle runs that a forager 
danced and the rate that she made her foraging trips (foraging tempo) increased with 
the quality of the forage source, and the rate that foragers ceased to forage from a 
source decreased as quality increased. This suggested that individual behavior leads 
to a distribution of foragers where there are high forager numbers at high-quality 
sources and low forager numbers at low-quality sources. 

Using the observations of Seeley et al. [9], Camazine and Sneyd [6] constructed 
a differential equation model to represent the flow of foragers between different 
behavioral classes. 

Like all subsequent differential equation models for foraging, this is a compart- 
ment model. The model traces the transitions that foragers make between resting, 
following dances, foraging, unloading, and dancing. The flow of foragers between 
different states is illustrated in Figure 4.1. The model assumes that when a bee begins 
foraging, she follows dances on the dance floor on a comb inside the entrance of the 
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FIGURE 4.1 Flowchart showing the flow of bees between compartments in the model of 
Camazine and Sneyd (1991) where there are two sources and using the notation of Equations 
4.1 through 4.4. (Adapted from Camazine, S and Sneyd, J., J. Theor. Biol., 149, 547, 1991.) 
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hive. If there are dances for several sources in the hive, she will choose one to follow 
and learn the location of that source. She then flies to that source and gathers nec- 
tar before returning to the hive and unloading. Once she has unloaded, she has the 
choice as to whether to continue to forage at that source or to follow another dance. If 
she does continue to forage, then she has the choice of whether to dance or not. The 
rate of recruitment by dancing is dependent on both the number of foragers dancing 
for a source and the number of waggle runs each dancer performs, which is, in turn, 
a function of the quality of the source. The rate of abandonment and failure to dance 
are also functions of source quality. 

Let A be the number of bees occupied in actively foraging at source A and B the 
number of bees foraging at source B. Let H, be the number of bees that are at the 
hive unloading nectar from source A and D, the number of bees that are dancing for 
source A; H, and D, are similar classes for source B. Finally, let F be the number of 
bees that are on the dance floor and seeking to follow dances. Camazine and Sneyd's 
model tracks the number of bees in each class (compartment) through the following 
differential equations: 

Rate of change of followers: 


dF fea fe 1 

—= X AS 1B = F 4.1 

dt Ta T? Trol i ! 
rate that rate that 


foragers abandon foraging ^ followers are 
at sources A and B andrgoin recruited to 
follower class Sources A or B 


where 
T$ and T? are the times it takes for a bee to decide to abandon source A or B, 
respectively, or continue once it has unloaded; 
f£ and f? are the probability that a bee will abandon source A or B, respectively; and 
Ten is the time that it takes a bee from the start of following dances until it is 
recruited to a source. 


As this is a deterministic differential equation model, these times could be regarded 
as means of a distribution of times. Clearly, not all bees will take exactly the same 
time to transition from one compartment to another. 

Rate of change of the number of foragers who are actively foraging at source A: 


da (1- f2)(1- h, " 1 p, " f F 1 A 
dt Ta T? Trai T? 
rate that bees return rate of rate of rate that 


directly to foraging after — returning to recruitment foragers return 
unloading without dancing foraging after of followers ^ and start 
dancing by dancers unloading 


(4.2) 
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where 

(1 — f) is the probability that a bee does not abandon source A immediately after 
unloading; 

(1 — f?) is the probability that a bee returns to source A without becoming a 
dancer; 

Tf is the time that a dancer takes to dance for source A before returning to forage; 

T? is the time that a bee takes to forage at source A before unloading in the hive; and 

f? is the probability that a follower will be recruited to source A and this prob- 
ability will be a function of the number of dancers at each source, D, and D,. 


Rate of change of the number of bees, who are committed to source A and who are 
unloading in the hive: 


dH 1 1 
= = A H.. 4.3 
dt T? Té e» 
rate that foragers wu 
tum and aar iiec i 
unloading m 


Rate of change of numbers of dancers for source A: 


db, fe(l-fo) H 1l 

dt Tr Të 
ratethat bees start rate that bees cease 

dancingforsourceA ^ dancing for source A and 


after unloading return to source A to forage 


D,. (4.4) 


Here, f?(1 — f?) is the probability that a bee who has finished unloading will not 
abandon source A but will dance for it. 

A set of equations similar to (4.2) through (4.4) apply to B, H,, and D,. This 
model assumes that the total number of bees that are available to become foragers is 
constant and that bees cycle through the tasks of following, foraging, unloading, and 
dancing and that all bees who engage in foraging must be committed to either source 
A or B or be actively following dances. 

If source A is better quality than source B, then this can be expressed mathemati- 
cally in this model by setting fz > f^, f? > fb and f*/T, < f°/T?. Using these ideas, 
Camazine and Sneyd were able to show that the model could reproduce the experi- 
mental results. 

Seeley et al. [9] had shown that if bees had the choice of two experimental feed- 
ers, one (the south feeder) with high-quality nectar and the other (the north feeder) 
with acceptable but lower-quality nectar, then the high-quality feeder would recruit 
more foragers than the lower-quality feeder. If the feeders were swapped after 4 h, so 
that the north feeder had high-quality nectar and the south feeder had lower-quality 
nectar, then the new high-quality source would recruit more foragers and the new 
low-quality source would lose foragers (see Figure 4.2a). Using parameter values 
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FIGURE4.2 Comparison of (a) the experimental results obtained by Seeley et al. [9] with 
(b) the results of the model of Camazine and Sneyd. (Plot a: Redrawn from Seeley et al., 
Behav. Ecol. Sociobiol., 28, 277, 1991; plot b: Redrawn from Camazine, S and Sneyd, J., 
J. Theor. Biol., 149, 547, 1991.) 


obtained experimentally, Camazine and Sneyd [6] were able to reproduce this behav- 
lor with their model (Figure 4.2b). 

This model is the earliest mathematical modeling for foraging. It linked individ- 
ual behavior—expressed mathematically by the likelihood that a bee would choose 
a state as given in the probabilities fz, f^, f$, f}, f" and fb, and in the average times 
that bees remained in different states, Ty, T4, T7, Te, T?, T? and T?—with collective 
hive behavior expressed in the way that the hive distributed its foragers over forage 
sources. 


4.5 FROM DIVERSE TASKS TO DIVERSE BEES 


Camazine and Sneyd's model [6] with different behavioral compartments was impor- 
tant as it allowed observations to be explicitly incorporated into the model. However, 
the model can be streamlined by collecting the bees who are dancing, foraging, or 


74 In Silico Bees 


unloading into a single group that is committed to a source [10]. This gives scope 
for relatively uncomplicated models for large number of sources or subclasses within 
the hive population. 

A forager completes a foraging cycle—flying to the source, gathering nectar, 
returning to the hive, unloading, and, perhaps, dancing—over a timescale of several 
minutes, but recruiting significantly more dancers or abandoning foraging at a source 
Occurs on a longer timescale that is closer to an hour. Therefore, it makes sense, 
mathematically, to group all committed foragers into a single class, regardless of 
their behavior and monitor only recruitment or abandonment. With a simpler model, 
it is also easy to include independent discovery of a source by scouting. 

The model of Cox and Myerscough [10] can be written purely in terms of the 
number of foragers for each source j, given by P! (this is equivalent to A + H, + D, 
or B + H, + D, in Camazine and Sneyd’s model [6]) and the number of unemployed 
foragers U. In the simplest terms, the equation for the rate of change of foragers com- 
mitted to source j is 


OF” = BJU -BJF + BJU (4.5) 
dt 
where 
the first term on the right-hand side represents recruitment by dancers of new 
foragers for source j; 
the second term represents abandonment of source j by foragers; and 
the third term represents unemployed bees who find source j by independent 
foraging and become committed to that source. 


A flowchart illustrating the dynamics of the model is given in Figure 4.3. The 
coefficients BJ, Bj, and Bj are not constant but depend on bee behavior. 

To model the effect of dancing for source j, we need to know the proportion of 
foragers committed to source j that are dancing at any one time. If we assume that 
foragers are evenly spread throughout the foraging cycle, then the proportion of for- 
agers that are dancing for source j is the same as the proportion of time in the forag- 
ing cycle that each forager spends dancing, multiplied by the proportion of foragers 
pi that are committed to source j who perform a dance rather than merely return to 
foraging after unloading. The proportion pġ is the same as the probability that any 
given scout who is committed to source j will dance at a given return to the hive. If 77 
is the average time that a single dancer spends dancing for source j on a given return 
to the hive and 7’ is the average visit rate for source j, so that the average total time 
spent in the foraging cycle for source j is 1/7, then the total number of dancers for 
source j at any given time is Di = Fip/Tiri. If we assume that the probability that an 
unemployed bee seeks to follow a dance is p, and that the rate of following a dance 
for source j is given by the proportion of dances that are for source j, then 


D! 


n 


(4.6) 


Models for the Recruitment and Allocation of Honey Bee Foragers 75 


Foragers committed 
to source 2 (F?) 


Pd T Mg 
B2(ngp D) | B2(ngp DT.) 
1 Utgp D B2p,2, pj, r?) ip ^»^1 
| 
Recruitment by dancers | B3(ngp D.) 
By (ng D ) l : 
Y N 
Foragers committed Abandonment Unemployed foragers |e .—.—.—. _| Foragers committed 
t 1 (F! 1 1 3.3.3. to source 3 (F? 
M Ú Beaver) | =o 
Recruitment by B3(ngp D, T) 
independent scouting 
Bj (naf DyT,) 


FIGURE 4.3 A flowchart showing the flow of bees between compartments in the model 
of Cox and Myerscough. (From Cox, M.D. and Myerscough, M.R. J. Theor. Biol., 223, 179, 
2003.) Here all foragers committed to a source are grouped into a single compartment and the 
transition rates are functions of the number of dancers advertising a site D;; the probability of 
abandoning source j, p/; the probability of dancing for source j, p/; the average visit rate for 
source j, 7; and the number of bees on the dance floor, na} More detailed explanations of the 
symbols are given in the text. 


where m is the total number of sources in the model. The probability that an unem- 
ployed forager finds a dance to follow will depend on how many dances are taking 
place on the dance floor and how many nondancing bees are present. The model 
assumes that these nondancing bees inhibit potential followers from finding dancers. 
If we assume that there are n bees on the dance floor (most of whom will not be 
dancers but resting foragers or receiver bees or other hive bees), then the probability 
of contacting a dancer to follow is 


1 
Pp: =— > Di (4.7) 
Nat — 
so that 
Bj E -lrigrjr (4.8) 
Nag Der 


If we assume that foragers that abandon sources do not dance, then the rate that for- 
agers abandon source j in any given foraging cycle is proportional to the probability 
that a forager does not dance and that a nondancing forager abandons the source in 
any given foraging trip. Hence, 


Bi = pi(1- pj)r (4.9) 


where pj is the probability of a nondancing forager abandoning the source. 
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We assume that an unemployed bee undertakes independent scouting when she 
cannot find a dance to follow within a period of time T,. Hence, 


poOEd 1x 
Bi === 1-—) D“ 4.10 
3 = Nat | el) 


where the term in brackets is the probability of only finding nondancing bees. This 
assumes that independent scouts have an equal probability of finding each of the m 
available sources. 

If the total number of bee available to become foragers is fixed, that is, 


U+% Ft= N (4.11) 
k=1 


where Nz is a constant, then the rate of change of the number of unemployed bees is 
given by 


SU y (pir «(Bf + BSW ) (4.12) 


k=1 


Many of the parameters of this model such as the visit rate 7 for source j and 
the probabilities of dancing p,/ (and so of recruiting by dancing) and of aban- 
doning a source j are strongly related to the profitability of that source. Cox and 
Myerscough [10] explicitly incorporated source profitability into their model 
and used the model to explore how foragers distributed themselves over multiple 
sources of varying profitability and then to explore how a forager workforce that 
had varying degrees of phenotypic variability [11,12] affected a hive's ability to 
gather food. While Cox and Myerscough [10] considered genetic factors as the 
source of variability, other factors such as age are just as likely to introduce varia- 
tion among foragers [13]. 

Because this model simplifies bee behavior and collects all the behaviors in the 
foraging cycle into one class, it makes it conceptually and computationally easier for 
other types of variations to be included. 

Of course, as foragers are divided into more and more compartments in a 
model, the number of foragers in each compartment becomes smaller and smaller, 
and so the assumption that underlies the use of ordinary differential equation 
models breaks down. That is, there are not enough individuals in each class to 
justify the assumption that a smooth average adequately represents their behavior. 
In this case, it is necessary to go to individual-based models where each bee is 
represented individually and rules are created for how individuals interact with 
one another and with their environment. These models will be briefly described 
in Section 4.8. 
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4.6 ROLE OF HIVE BEES: MODELING INTERACTIONS 
BEYOND FORAGERS AND DANCERS 


Foragers are, of course, not isolated from the rest of the hive and interact with the 
other bees in the colony in other ways besides dancing. The main class of hive bees 
that interact with active foragers are receiver bees that collect nectar from incoming 
nectar foragers and store it in the combs of the hive. There is some evidence that a 
forager's tendency to rest, rather than return to the forager source and to dance or 
not, depends on the time that it takes her to find receiver bees and unload [1,3]. If 
it takes a long time for a forager to offload the nectar that she has collected, then 
she is less likely to dance and less likely to return to forage. Receiving nectar may 
take longer when there is an unusually large amount of nectar being brought into the 
hive or when the combs are nearly full so that receivers have to search for cells to 
store the nectar that they are carrying, which means that they are away from the hive 
entrance for a long period of time. In either case, the need to forage is less urgent 
when there is plenty of nectar being brought into the hive or when the supplies of 
stored nectar are high. Edwards and Myerscough [14] have constructed a model to 
explore how a forager's search time for nectar receivers may be a vehicle for commu- 
nicating the hive's need for nectar to the foraging work force and inhibiting foraging 
if it is not immediately necessary. Figure 4.4 illustrates how search time information 
allows foragers and receivers to transfer information from one class to the other. 
Edwards and Myerscough devised an ordinary differential equation model, which 
includes the effects of feedback from search time on foragers’ behavior and nectar 
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time 


Reset, 
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FIGURE 4.4 Diagram illustrating how foragers and receiver bees implicitly exchange 
information via the search time. (From Edwards, J.R. and Myerscough, M.R., J. Theor. Biol., 
271, 64, 2011.) 
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collection. There are two classes of bees in this model: foragers, numbering F, and 
receiver bees with numbers denoted by R. Each of these classes contains a subclass 
of bees that are active in nectar exchange: F, the number of foragers actively unload- 
ing and R, the number of receivers actively receiving or waiting to receive. The 
model depends on the key variable, search time, S(f), which is given by 


(4.13) 


where S(f) is the time taken to find a receiver bee and unload, which is assumed to 
depend on the ratio of the quality of the nectar to be unloaded, Q, to some scaling 
factor Qy, which may be regarded as the maximum quality that the bees expect. The 
search time also depends on the fraction of bees in the entrance that are receivers, 
ROF +R). This assumes that the only bees that a returning forager will encoun- 
ter are receivers or other foragers. The parameter s is a constant that reflects the time 
that a returning forager takes to determine if a bee that she encounters is willing to 
receive her nectar. We assume that the actual unloading time is small compared to 
the search time. 

We assume that the probability that a forager will dance or abandon foraging 
and return to resting depends on the search time and on the quality of the source. 
If search time is high, that is, a forager takes a long time to find a receiver willing 
to receive her load of nectar, and the quality of the source that she is exploiting is 
low, then she is unlikely to dance and prone to rest rather than return to foraging. 
A forager who is exploiting a high-quality source and is able to rapidly unload her 
nectar is most likely to dance and to continue foraging. Under these assumptions, the 
equation for the rate of change of forager numbers F is 


£ = fF (t) i(S(t),Q)— fF (t), (S(t),Q) (4.14) 


The first term on the right-hand side represents recruitment of new foragers to the 
source and the second term represents the rate that foragers cease to be active and 
return to rest. We assume that scouting is not important in this model. The constants 
f and f, control the rate of recruitment and return to rest, respectively. The functions 
I (S,Q) and [I ,(S,Q) are sigmoid functions shown in Figure 4.5 and given explicitly 
in [14]. 

The rate of change of the number of foragers in the entrance of the hive waiting 
to unload is given by 


(4.15) 


The first term on the right-hand side gives the rate that foragers arrive at the hive and 
start to seek to unload. Here, F — F is the number of foragers that are not waiting to 
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FIGURE 4.5 Contour plots of functions (a) I',(S,Q) and (b) T’,(S,Q). These functions both 
have ranges between 0 and 1; I';(S,Q) is high for sources of high quality when waiting time is 
short and I5(S,Q) is high for sources of low quality when waiting times are long. 


unload, and f, is the time that a forager takes to complete one foraging cycle, so that 
1/f, is the rate of arrival of foragers at the hive, assuming that foragers are evenly 
distributed through the foraging cycle. 

If we assume that the total number of receiver bees R, is constant, then the 
equation for the rate of change of receiver bees in the entrance is 


(4.16) 


where the first term represents the rate of return of receiver bees to the entrance 
of the hive and to readiness to receive and the second term represents the rate that 
foragers find and unload to a receiver, assuming that this can be well-approximated 
by a relationship of one forager to one receiver bee. The constant r, represents the 
time that it takes a single receiver to offload the nectar that she carries into a cell in 
the honey comb. 

Using this model, Edwards and Myerscough [14] showed that tuning dancing and 
resting rate using information from search time limited the number of foragers that 
were recruited during times when high-quality nectar was abundant (Figure 4.6) 
but allowed foragers to recruit freely when nectar was less abundant. Essentially the 
forager workforce was limited by the limited number of receiver bees. 

In a real hive, when foragers are faced with long waiting times before they 
unload, they perform a tremble dance, which may recruit more receivers and dis- 
courage other foragers from visiting the same source [15]. If the tremble dance is 
included in the model so that the total number of receivers R(f) is no longer con- 
stant, then the forager numbers continue to increase but more slowly than the initial 
rapid increase. 

There is good reason why a hive might be parsimonious with their foragers; 
there is a limit to how much nectar a hive needs to store, and foragers are the most 
vulnerable of all the behavioral castes in the hive. If many bees go outside to forage 
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FIGURE 4.6 Results from the model of Edwards and Myerscough, showing how the limited 
number of receiver bees curtails the recruitment of foragers when nectar is abundant, but not 
when nectar is scarce. In (a) and (b), the hive is exploiting a high-quality source with Q=3, 
but in (a) the hive has 100 receivers and in (b) 50 receivers. In (c) and (d), the hive is exploiting 
a relatively low-quality source with Q=1.3 with 100 receivers in (c) and 50 receivers in (d). 
(From Edwards, J.R. and Myerscough, M.R., J. Theor. Biol., 271, 64, 2011.) 


and there is a rapid loss of foragers, then the hive itself may be endangered [13]. It 
is also possible that the availability or otherwise of receivers may reflect the capac- 
ity of the hive to store nectar. A receiver who has to search for space to unload her 
nectar in a honey comb that is almost full will take longer than if there are many 
cells with space for nectar storage. In this way, the interaction between receivers 
and foragers may be able to provide feedback to the foragers about the hive’s need 
for nectar. 

The model of Edwards and Myerscough [14] can be extended to multiple sources. 
In this model, when different sources have different quality nectar, the foragers that 
exploit those sources experience different search times. This means that recruit- 
ment to good-quality sources is even stronger relative to recruitment to poor-quality 
sources than in Camazine and Sneyd’s model [6] (Figure 4.7). This is particularly 
evident in the model results for the feeder swapping experiment, when tremble danc- 
ing is included. 
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FIGURE 4.7 Diagrams showing the effect of tremble dancing and the effect of the time 
that the feeders are swapped in the Edwards and Myerscough model. In (a) and (b), there is 
no tremble dancing—the number of receivers is fixed, but in (c) and (d), more receivers are 
recruited by foragers who tremble dance in response to long search times (see Edwards and 
Myerscough, 2011 for details). In (a) and (c), the feeders are swapped after 1 h, but in (b) and 
(d), the feeders are swapped after 2 h. The increase in the number of receivers due to tremble 
dancing in (c) and (d) means that more foragers are in the field, and so more foragers are 
recruited to the second site after swapping. The search time that is plotted is for the more 
profitable site. (From Edwards, J.R. and Myerscough, M.R., J. Theor. Biol., 271, 64, 2011.) 


4.7 GENERALIZED ODE FORAGING 
MODELS: ARE BEES LIKE ANTS? 


Honey bees are not the only social insects that forage collectively by passing 
information about forage sources from one member of the colony to another. Ants 
also share information, sometimes through trail laying and sometimes through 
knowledgeable individuals leading novices to the food source. 

Sumpter and Pratt [16] devised a generalized framework for writing ordinary 
differential equation models for social insects. Their framework relies on break- 
ing down the foraging cycle into various behavioral compartments such as waiting, 
searching, exploiting, and recruiting. In this sense, this framework is closer to the 
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model of Camazine and Sneyd [6] than those of Cox and Myerscough [10] or Edwards 
and Myerscough [14]. By choosing appropriate functional coefficients in their frame- 
work, they were able to write example models for ant foraging using pheromone 
trails and for honey bee foraging with both dancing and independent scouting. Their 
honey bee model agrees better with experimental results in the initial phase of for- 
aging expansion than Camazine and Sneyd's model, possibly because Sumpter and 
Pratt introduce a class of bees that have followed a dance and are now engaged in 
searching for the advertised source. This inherently will slow down recruitment to 
the class of bees that are exploiting the source. They note, however, that their model 
does not represent the experimental results for the swap between sources as well as 
Camazine and Sneyd's model. 

Sumpter and Pratt [16] comment that ant foraging is like honey bee foraging 
where ants are leading new foragers to the forage source by group recruitment or tan- 
dem running. When ants use pheromone trails, however, their foraging recruitment is 
qualitatively different to honey bee dance recruitment as the recruitment takes place 
not by direct individual-to-individual communication but with the environment— 
that is the pheromone trail—as an intermediary in the process. 


4.8 INDIVIDUAL-BASED MODELS AND 
DIFFERENTIAL EQUATION MODELS 


Ordinary differential equation (ODE) models possess a conceptual clarity and force 
the modeler to consider what are the key processes in the system that they are repre- 
senting. The choices that a modeler makes in constructing an ODE model depend, to 
a large extent, on the purpose of their model and the scale that they want to explore 
with their model system. For example, a modeler who wanted to look at the distri- 
bution of individuals in different parts of the foraging cycle needs to use a model 
similar to those of Camazine and Sneyd [6] or Sumpter and Pratt [16], but if they 
want to look at the distribution of individuals among many different sources, it may 
be better to use the model of Cox and Myerscough [10], which collects all individu- 
als foraging at the same source into a single class regardless where they are in the 
foraging cycle. 

Dividing the hive or the forager workforce into many different categories will 
inevitably lead to a situation where many classes might only have one or two indi- 
viduals each. This introduces a “graininess” to the problem and violates the assump- 
tion that there are enough individuals in each class to think of foraging in terms of 
average numbers or rates. A different sort of model is needed to represent the cases 
where there are many different classes or where particular distinct characteristics are 
imputed to individuals. 

Individual-based models represent the colony or the part of the colony of interest 
as a number of individuals who each have their own set of characteristics and at each 
time step behave according to a set of rules imposed by the modeler. These rules may 
involve interactions with other hive members or with the environment. Individual- 
based models can be very directly constructed from observational data to give an 
in silico colony, but it is not always easy to tease apart how different behaviors and 
interactions contribute to the computed colony-wide behavior. 
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A very detailed individual-based model was first proposed by de Vries and 
Biesmeijer [7]. This model included details such as the individual bees' positions 
on flying out to a source or scouting and a bee's experience of foraging, includ- 
ing a knowledge of sources where she had previously foraged. They compared their 
model to Seeley et al.’s [9] empirical data and obtained a reasonable match but not as 
close as expected, given the detailed model and care with experimental parameters. 
Their model did suggest, however, that the foraging history of individual foragers is 
important; bees remember the odor and location of previously profitable sources and 
may undertake reconnaissance flights to those sources before seeking other sources, 
either through dancing or independent scouting. This type of behavior would be 
very difficult to incorporate into a differential equation model. A later extension of 
this model included monitoring of energy harvest rates and cross-inhibition between 
sources [17]. 

When a hive forages over a large number of patches, each with a distinct location 
and quality, this is best represented by an individual-based model. Dornhaus et al. 
[18] used individual-based models to examine when recruitment to foraging was 
advantageous compared to independent scouting and concluded that recruitment was 
most advantageous in environments where there were few patches of forage of poor 
or variable quality. 

Schmickl et al. [19] use an individual-based model to examine a similar question 
to that of Edwards and Myerscough [14]: How does feedback from nectar receivers 
affect the foraging effort? Their model (Figure 4.8) is much more complicated than 
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FIGURE 4.8 Flowchart for the individual-oriented model of Schmickl et al. [19]. The black 
arrows represent the flow of individuals from one compartment to another and the gray arrows 
represent interactions among different classes of bees. (With kind permission from Springer 
Science+Business Media: Neural Comput. Appl., Swarm-intelligent foraging in honey bees: 
Benefits and costs of task-partitioning and environmental fluctuations, 21, 2012, 251—268, 
T. Schmickl, R. Thenius, and K. Crailsheim.) 
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that of Edwards and Myerscough but reaches much the same conclusion, that limit- 
ing the receiver numbers limits the number of foragers that are out in the field. 

There are definite benefits in applying individual-based models to certain types 
of problems in honey bee foraging, but depending on the problem, it may be more 
worthwhile to avoid the very complicated and time-consuming computations that 
these models need and to think carefully about abstracting the model system into a 
differential equation model. 


4.9 ALGORITHMS INSPIRED BY HONEY BEE FORAGING 


The cooperative foraging behavior of honey bees has been a source of inspiration 
for numerical techniques for solving a wide variety of problems. Indeed much of the 
literature in this area references Camazine and Sneyd's model [6]. Intuitively, algo- 
rithms based on foraging seem well suited to problems of efficient task allocation 
and optimal use of resources, but the list of applications for these algorithms extends 
well beyond these problems. Some important foraging inspired techniques include 
BeeHive [20], Bee Colony Optimization (BCO) [21], the Artificial Bee Colony (ABC) 
algorithm [22], and the Bees Algorithm (BA) [23]. BeeHive has been used princi- 
pally for studies of efficient routing of data packets through a network and has been 
extended to include an Artificial Immune System security framework [24] inspired 
by the principles of the human immune system. Bee Colony Optimization has been 
used to examine complex transportation problems [21], job shop scheduling (the 
problem of distributing n tasks of varying duration between m machines such that 
the total duration to complete all tasks is minimized) [25,26], and constrained port- 
folio optimization (the problem in finance of constructing a portfolio of shares, and 
possibly derivatives, that will likely maximize profit for the portfolio holder subject 
to constraints based on the portfolio holder's aversion to risk) [27]. The Artificial Bee 
Colony algorithm and the Bees Algorithm cover the widest range of applications, 
including standard mathematical problems of finding the optimal value of func- 
tion of many variables, training or optimizing neural networks, and data clustering. 
A comprehensive list of numerical techniques inspired by honey bees up until 2008 
can be found in the review of Karaboga and Akay [28]. 
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ABSTRACT 


Mathematical models have been successfully used to study the progression of vari- 
ous infectious diseases for many years. In this chapter, we demonstrate how the 
susceptible—infected—removed (SIR) modeling framework can be applied to study 
diseases of honey bee colonies. We focus on the acute bee paralysis virus, which is 
transmitted by the parasitic mite Varroa destructor as a vector. The resulting model 
consists of four nonautonomous, nonlinear ordinary differential equations, which 
we study with analytical and computational techniques. Our results indicate that, 
depending on model parameters, in the absence of the virus, a mite infestation can 
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lead either to extinction of the bee colony or to an endemic infestation that allows the 
bee colony to survive. However, when the mites also carry the virus, this infection 
is very difficult to be fought off without remedial intervention and might lead to the 
extinction of the colony. 


KEYWORDS 


Acute bee paralysis virus, Honey bees, Mathematical model, Ordinary differential 
equations, SIR model, Varroa mite, Vector-borne disease 


5.1 INTRODUCTION 


Honey bees, like all animals, have diseases and pests that can destroy individuals or 
the entire colony if not treated in time. Diseases in the honey bee colony are mainly 
caused by pests and parasites, bacteria, fungi, and viruses [1]. This chapter focuses 
on viral diseases in honey bee colonies for which the parasitic mite Varroa destruc- 
tor acts as a vector. Besides vectoring diseases, varroa mites also affect the life span 
of honey bees by feeding on the bee's hemolymph and by piercing its intersegmen- 
tal membrane [2,3]. There have been at least 14 viruses found in honey bee colo- 
nies [4,5], which can differ in intensity of impact, virulence, etc., for their host. For 
example, the acute bee paralysis virus (ABPV) affects the larvae and pupae that fail 
to metamorphose to adult stage, while in contrast the deformed wing virus (DWV) 
affects larvae and pupae that can survive to the adult stage [6]. Varroa mites are the 
main agents of transmission of viruses between bees. Transmission occurs when 
mites feed on bees and when a virus-carrying mite attaches to a healthy bee during 
the former's phoretic phase [3,7,8]. Thus, the previously uninfected bee becomes 
infected. A virus-free phoretic mite can begin carrying a virus after it moves from 
an uninfected to an infected bee [8,9]. 

The relationships between honey bees, parasitic mites, and viruses comprise a com- 
plex, interdependent system with nonlinear interactions. It cannot be understood by 
studying the three players, host, vector, and virus, individually and superimposing the 
findings. Instead, their interdependencies must be taken into account. For example, not 
only does the virus have an effect on the bee population, but also a decreasing bee pop- 
ulation affects the mites, which again alters disease transmission. For several decades, 
mathematical models have been developed as a major tool to understand the course 
and complexity of infectious diseases in human populations and to aid in the develop- 
ment of vaccination and control strategies. In this chapter, we describe how this highly 
successful methodology can be adapted to study the effect of varroa mites and their 
viruses in honey bee colonies. We stress that although these mathematical models 
are predictive, they are primarily qualitative, rather than quantitative, in nature. Their 
main purpose is not to predict how many bees in a colony become infected by a certain 
virus and when. Their real power lies in describing the fate of a disease qualitatively 
and to provide insight under which conditions a disease can be eradicated or when it 
will overcome the colony, potentially eradicating it. Such disease models can also be 
valuable tools for investigating the effectiveness of remedial and disease control strate- 
gies. But this aspect is beyond what we want to achieve in this chapter. 
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5.2 MATHEMATICAL MODELS 


Mathematical models are (sometimes simple) representations of complex real-world 
problems. They can increase our understanding of the processes involved and of 
their interplay. Mathematical models have a long tradition in most disciplines of sci- 
ence and engineering. The aim of all scientific study is to derive theories that enable 
us to make predictions. A mathematical model is the formulation of such a theory. 
Mathematical modeling requires a good command of mathematical tools and an 
understanding of the underlying physical or biological phenomena. 

The formulation of a mathematical model is a careful trade-off between com- 
plexity, difficulty, and accuracy. Increased complexity ideally also increases accu- 
racy, but always at the expense of added difficulty. Difficulty can take several forms. 
Foremost, this refers to the difficulty in obtaining a solution of the mathematical 
model, either analytically or computationally. Equally important, however, is the 
difficulty in providing the additional information required, such as parameters or 
other input data for the model. Often, the theoretical accuracy gain of a more com- 
plex model can be completely lost if the additionally required information cannot be 
obtained and must be substituted by crude assumptions. 

Every mathematical model is specific to its purposes and no model fits all. 
Moreover, mathematical models are not unique. Often several mathematical mod- 
els can be formulated for seemingly the same, say, biological or physical process. 
Models differ in the assumptions on which they are based and in the mathemati- 
cal machinery used. As a general rule, mathematical models that contain lots of 
details without relevance to the question at hand are not desired. In some sense, that 
can be understood as a consequence of Occam’s razor: Simpler explanations are, 
other things being equal, generally better than more complex ones. In other words, a 
model should be as simple as possible and as complicated as necessary. 

Model formulation is an iterative, multifaceted cyclical process as shown in 
Figure 5.1. First, the most essential features of real-world problems are identified 
and described in mathematical terms. Once such a candidate mathematical model 
is formulated, it is analyzed with respect to its internal consistency. For most math- 
ematical models, it is not possible to write down the solution. In fact, the primary 
question a modeler has to ask is whether or not his or her model actually possesses 
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FIGURE 5.1 The modeling process as an iterative process. 


90 In Silico Bees 


a solution and, if so, whether it is unique and satisfies important properties. For 
example, in mathematical ecology, it is expected that population sizes predicted by 
a model are not negative. In some cases, these mathematical questions are relatively 
easy to answer using standard theory, for example, for many ordinary differential 
equation models. In other cases, this might involve highly nontrivial mathematics, 
for example, in models that consist of nonlinear systems of partial differential equa- 
tions. In fact, this step in the modeling cycle can be so challenging that in many cases 
one postpones it until the first computational results are obtained to decide whether 
the model is worth pursuing. 

After the mathematical model is checked for its consistency, the next step is 
to obtain its solution. In most cases, that needs to be done computationally, using 
numerical methods to approximate the unknown solutions of the model. The com- 
puter simulation results are then subjected to scrutiny. First, it is verified that the 
computational results indeed are good approximations of the unknown solution of 
the underlying model. It is also validated whether or not the computer results agree 
with the theoretical properties that have been established. On the other hand, com- 
putational results can also inform the mathematical analysis and lead to an improve- 
ment of theoretical results. Second, the computational results are interpreted in 
their biological or physical context. This might lead to further model refinement 
and increased complexity. In other cases, it might be determined that the model is 
overly complex and can be simplified. The modeling cycle begins anew. Eventually, 
one arrives at a mathematical model that is deemed satisfactory for the current situ- 
ation but would need to be modified if used to tackle a different problem. Also, 
when new scientific knowledge becomes available, the mathematical model needs 
to undergo new scrutiny. As such, mathematical modeling is inherently Popperian: 
Mathematical models can be validated but never verified; falsifiability is one of the 
main characteristics of a mathematical model. And *He who decides one day that 
scientific statements do not call for any further test, and that they can be regarded as 
finally verified, retires from the game [of science]" [10]. On the other hand, “Once 
a hypothesis has been proposed and tested and has proved its mettle, it may not be 
allowed to drop out without “good reason’” [10]. 

Once a mathematical model is accepted as sufficiently appropriate for the problem 
at hand, computer simulation experiments are conducted to investigate a particular 
scientific question. Such computer simulation experiments can resemble laboratory 
or field experiments, but also differ from them. The big advantage of simulations 
is that they are usually cheaper to carry out, often faster, and always easier to con- 
trol. On the other hand, they are subject to inherent uncertainty, in particular if 
no experimental data are available for quantitative validation. Even if a model is 
quantitatively not validated, if it is grounded on accepted and well-understood basic 
principles, it can offer great insight into the potential behavior of the system that 
it models. In the words of Heinrich Hertz: “We form ourselves images of external 
objects and the form which we give them is such that the necessary consequents of 
the images in thought are always the images of the necessary consequents in nature 
of the things pictured" [11]. The form that we give them is determined by the math- 
ematical expertise and experience of the modeler. The consequents of the images, 
the model predictions, offer potential explanations or testable hypotheses for the 
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consequents of the things pictured. As such, they inform future experimental studies 
or suggest potential interventions to avoid undesirable consequences. This, in fact, is 
an important area for the application of mathematical models and applies to a broad 
class of models used in science and engineering, among which are many infectious 
disease models. 


5.3 INFECTIOUS DISEASE MODELS 


The course of infectious diseases can be predicted using mathematical models that 
have been developed over many years and have experienced a huge surge in activ- 
ity in the last decade [12-14]. While most of these research efforts are driven by 
diseases of human populations, the underlying concepts can be adapted to diseases 
of animals as well. Because parameters change temporally and geographically, an 
accurate quantitative prediction of future epidemics over several years normally 
cannot be expected, especially for newly emerging diseases. Consequently, also a 
quantitative validation is only possible after the fact. However, instead of focusing on 
quantitative predictions, the real strength and power of the mathematical approach to 
understand disease dynamics are the qualitative insight that it gives into the complex 
interplay between host and disease. In this light, the success of infectious disease 
models has been phenomenal, even in the absence of accurate data that describe a 
particular disease quantitatively. We want to make use of this successful strategy for 
honey bee diseases. 

The traditional modeling framework that we have adapted for virus infections in 
honey bee populations, is the so-called susceptible—infected—removed (SIR) models 
in which the population is described in terms of susceptible and infected individu- 
als; further particularities depend on the disease under consideration. For viruses in 
honey bees, several of the simplifying assumptions often made in infectious disease 
models for humans are not possible. For example, because the bee population size 
fluctuates greatly with the seasons and because viral diseases can reduce the popu- 
lation considerably, to the point of extinction, the usual assumption that the overall 
population size remains relatively unaffected by the virus and can be considered a 
constant is not possible, leading to more algebraically involved models. Moreover, 
because the characteristic timescale of the disease is comparable to or even bigger 
than the characteristic timescale of bee biology, birth and natural death of bees can- 
not be neglected and models must be developed that account for the particularities 
of bee reproduction. Furthermore, ABPV and other varroa-associated viruses are 
to be modeled as vector-borne diseases; a possible extension of the SIR modeling 
framework for vector-borne diseases is Ross-Macdonald model [15]. 

The basic, traditional SIR model divides the host population into susceptible 
(S), infected (I), and removed or recovered (R) individuals. The susceptibles are 
individuals that are not currently, but may become, infected, and the infected 
group consists of individuals that are currently infected. Depending on the dis- 
ease, the R group can indicate those individuals who were infected but have now 
recovered from the disease or those who were removed, for example, by death. 
The SIR model is conceptualized in Figure 5.2. Each compartment in this model 
is described by a relatively simple ordinary differential equation that constitutes 
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FIGURE 5.2  Conceptualization of the SIR modeling framework: After infection, sus- 
ceptible individuals leave the S compartment and enter the I compartment. After recovery/ 
removal, they leave the I compartment and enter the R compartment. The infection rate can 
depend on both, that is, the number of already infected and susceptible individuals. 


Susceptible bees 


Mites car- ' Mites not 
rying virus carrying virus 


FIGURE 5.3 Role of mites in the spread of infection in a honey bee colony: Virus-carrying 
mites affect the transmission rate from susceptible to infected bees. All mites, virus carrying 
or not, affect mortality of susceptible and infected bees. 


a “mass balance,” that is, a balance of gain and loss in the compartment. The 
rate at which susceptible individuals become infected, that is, the rate of transfer 
from the S into the I compartment, depends on the number of already infected 
individuals but can also depend on the number of susceptible individuals. In the 
literature, the SIR model has been adapted to describe a variety of diseases. For 
example, it can be considered that recovered individuals become susceptible 
again. An extension of the model to vector-borne diseases can be achieved by 
making the infection rate dependent on the number of vectors that carry the virus. 
In many instances, this requires the inclusion of additional differential equations 
that describe how the vector population evolves and how vectors acquire the virus 
(see, e.g., Figure 5.3). 


5.4 APPLICATION TO HONEY BEES, VARROA MITES, 
AND THE ACUTE BEE PARALYSIS VIRUS 


We apply the traditional SIR modeling framework to describe the fate of a honey bee 
colony that is exposed to the ABPV. ABPV, together with the Kashmir bee virus, 
black queen cell virus, and the Israeli acute paralysis virus, belongs to the family 
Dicistroviridae. These viruses share a number of biological characteristics, such as 
principal transmission routes and primary host life stages [16]. ABPV is a common 
infective agent of honey bees that is frequently detected in apparently healthy colo- 
nies. Bees affected by this virus are unable to fly, lose hair from their bodies, and 
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tremble uncontrollably. The virus has been suggested to be a primary cause of bee 
mortality. Infected pupae and adults suffer rapid death. ABPV is associated with 
varroa mites and has been implicated in colony collapse disorder. Due to the simul- 
taneous appearance of mite and virus under field conditions, it is difficult to sepa- 
rate the effects of both pathogens [17]. Therefore, they should be studied together, 
and mathematical models of the disease dynamics should include both pathogens 
simultaneously. 

In the SIR framework, susceptible individuals are healthy bees, infected 
individuals are sick bees, and the vector is the varroa mite. The virus is trans- 
mitted to the bees via mites that feed on their hemolymph by piercing the 
intersegmental membrane. The model for honey bees is with demography, that 
1s, the birth and the death of the bees is taken into consideration. In our case, the 
removed compartment is the deceased bees. A schematic of the virus transmis- 
sion is given in Figure 5.3. The mites that carry the virus affect the transmission 
of the disease. All mites, vector carrying or not, affect the mortality of susceptible 
and infected bees. 

The primary dependent variables for our model are the healthy (susceptible) bees, 
x, and the virus infected bees, y. The transmission of the disease is by the vectoring 
varroa mites M, and the mites carrying the virus are denoted by m. The deceased 
bees are denoted by R. In our model, we include birth and natural death of bees, bee 
death due to parasitic mites, infection of healthy bees with the virus, bee death due to 
the disease, transfer of the virus between mites, and the evolution of the mite popula- 
tion. The governing equations read 
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Here, all coefficients and parameters depend on time í to reflect seasonal changes in 
the bee—mite—virus population and transmission dynamics. Because the dependent 
variables x, y, m, and M do not depend on R, Equation 5.5 would decouple from 
Equations 5.1 through 5.4. 
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The function g(x,f) in (5.1) expresses that a sufficiently large number of healthy 
worker bees are required to care for the brood. We think of g(x,f) as a switch func- 
tion. If x falls below a critical value, which may seasonally depend on time, then 
essential work in the maintenance of the brood cannot be carried out anymore and 
no new bees are born. If x is above this value, the birth of bees is not hampered. A 
mathematically convenient formulation of such switch-like behavior is given by the 
sigmoidal Hill function: 


n 


"Kon oP 


9(xt) 


Here, the parameter K(?) is the size of the bee colony at which the birth rate is half of 
the maximum possible rate and the integer exponent n> 1. 

The function h(m, f) in (5.1) indicates that the birth rate is affected by the pres- 
ence of mites that carry the virus. This is, in particular, important for viruses 
like ABPV that kill infected pupae before they develop into bees. The function 
h(m, t) is assumed to decrease as m increases and h(0,t) =1(no reduction in bee 
birth in the absence of the virus); [6] suggests that this is an exponential function 
h(m,t) = e™®, where k(#) is nonnegative. We use this expression in the computer 
simulations later on. 

The parameter p, in (5.3) is the rate at which mites that do not carry the virus 
acquire it. The rate at which infected mites lose their virus to an uninfected host 
is B,. The rate at which uninfected bees become infected is B, in bees per virus- 
carrying mite and time. 

Finally, d, and d, are the death rates for uninfected and infected honey bees. 
We can assume that infected bees have shorter lives than healthy bees, thus d,>d,. 
The last equation of the model is a logistic growth model for varroa mites. By r, we 
denote the maximum mite birth rate. The carrying capacity for the mites changes 
with the host population site, x+y, and is characterized by the parameter a, which 
indicates how many mites can be sustained per bee on average. This assumption is 
in agreement with [18]. 

Mites contribute to an increased mortality of bees. This is considered in (5.1) and 
(5.2) by including death terms that depend on M; the parameters y, are the rate at 
which mites kill bees. 

The mathematical model mentioned earlier is based on Sumpter and Martin 
[6] and Eberl et al. [19]. In Sumpter and Martin [6], the mite population in the 
hive was assumed to be a given model parameter and the honey bee birth rate 
was assumed to be a constant; moreover, the model was considered for constant 
coefficients only, that is, without seasonal fluctuations. Eberl et al. [19] added 
the brood maintenance terms g(x, f) and seasonal fluctuations. In the aforemen- 
tioned formulation, it was also added that the mite population is not a given model 
parameter but is described by a logistic growth equation with a carrying capacity 
that depends on the current bee population size. Therefore, this model can be 
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considered a fourth iteration of the modeling cycle toward understanding the fate 
of bee colonies if infested by ABPV-carrying mites. 


5.5 COMPUTER SIMULATIONS OF THE DISEASE MODEL 


5.5.1 COMPUTATIONAL SETUP AND PARAMETERS 


Models (5.1) through (5.4) comprise a system of four nonlinear, nonautonomous 
ordinary differential equations. An exact analytical solution in closed form cannot 
be found, but many suitable and well-tested computer algorithms are readily avail- 
able for their numerical approximation. Such a simulation requires explicit numeri- 
cal values for the model parameters even if the overall goal is a phenomenological 
qualitative understanding rather than a quantitative prediction. The parameters 
u, K, o, Bi, di, yi, g(x), h(m), r are assumed to be nonnegative. They can change 
with time. In particular, major differences may be observed between seasons. For 
example, the life span of a worker bee in summer is much shorter than in win- 
ter [2,20]; the birth rate for bees is higher in summer than in spring and autumn, 
and it drops down to 0 in winter [21]. Seasonal averages for the model parameters 
P1231, dio, K can be derived from the data in Sumpter and Martin [6]. These are 
summarized in Table 5.1 and will be used in the simulations later. Numerical values 
for the remaining parameters r, a, and K can be estimated (order of magnitude) from 
other data in the published literature. In our computer simulations, these are the 
parameters that we vary to understand the model's behavior. 

For computer simulations, we use the software package MATLAB®. The ordi- 
nary differential equations are integrated by the built-in routine odel5 s, a variable 
order solver based on numerical differentiation formulas. In all cases, we run the 
computer simulations for a period of 7,000 days (approx. 20 years) or until the colony 
vanishes, whichever comes first. 


TABLE 5.1 

Seasonal Averages of Model Parameters 
Parameters Spring Summer Autumn Winter 
p. 0.1593 0.1460 0.1489 0.04226 
p. 0.04959 — 0.03721 0.04750 —— 0.008460 
Bs 0.1984 0.1460 0.1900 0.03384 
d, 0.02272 0.04 0.02272 0.005263 
d, 0.2 0.2 0.2 0.005300 
u 500 1,500 500 0 

k 0.000075 0.00003125 0.000075 N/A 

r 0.0165 0.0165 0.0045 0.0045 


Source: Derived from Sumpter, D.J.T. and Martin, S.J., J. Animal 
Ecol., 73, 51, 2004. 
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5.5.2 ILLUSTRATIVE RESULTS 


Before studying the full models (5.1) through (5.4), we start with the smaller virus- 
free submodel. That is, we assume that initially no sick bees and no virus is in 
the system, y(0) = m(0) =. It is easily verified from (5.1) through (5.4) that then 
y (t) -m (t) — 0 for all time, in accordance with biological expectation. 

Illustrative simulations are shown in Figure 5.4, for two different sets of brood 
maintenance coefficients K: one at the lower end of the estimated range for this 
parameter, K=6,000 (spring), K=8,000 (summer), K=6,000 (fall), K=6,000 (win- 
ter), in panels (a) and (b), and one at the higher end K= 11,800 (spring), K= 12,000 
(summer), K= 11,800 (fall), K=6,000 (winter), in panels (c) and (d). For o, we use 
0.4784 (Winter, Spring), 0.5 (summer, autumn) in both cases. We compare the 
development of the bee population in the absence ((a), and (c)) and in the presence of 
mites ((b) and (d)). 

Without mites, the bee population assumes a periodic pattern after a brief tran- 
sient period due to initial conditions. The bee colonies are strongest in summer and 
then decline through fall and winter before they increase again in spring, etc. For 
lower K (i.e., fewer worker bees are required to maintain the brood), the population 
size is somewhat larger than for higher values of K. With mites, but no viruses, in the 
colony, the model predicts for the chosen parameters a coexistence of mites and bees. 
The bee colony is slightly smaller than in the mite-free case but can still be consid- 
ered of healthy strength. The mite population assumes a periodic pattern as well 
from the second year on. These simulations suggest the possibility of coexistence of 
bees and mites at relatively healthy bee population levels. 

That, however, mites alone, even in the absence of virus, can lead to a decline 
of the bee colony is suggested in a further simulation, as shown in Figure 5.5. 
Here, the tolerance of the bees to the mites, expressed in terms of parameter a, 
was reduced to «=0.1321 in spring and summer. We repeat the simulation of bees 
and mites for four slightly different sets of brood maintenance coefficients K (a) 
K=11,600 (spring), K=12,000 (summer), K= 11,600 (autumn), K=6,000 (winter), 
(b) K= 11,700 (spring), K= 14,000 (summer), K 2 11,700 (autumn), K 26,000 (winter), 
(c) K=11,900 (spring), K=14,000 (summer), K=11,900 (autumn), K=6,000 (win- 
ter), (d) K=12,200 (spring), K=14,000 (summer), K-12,200 (autumn), K=6,000 
(winter). 

For the first case (a), we see qualitatively the same picture as in Figure 5.4. 
However, for, depending cases (b) through (d), the bee colony vanishes after the 
fourth, third, and second winter, respectively. This suggests that the fate of a virus- 
free, but mite-infested, bee colony, that is, the question of whether or not it survives 
or vanishes, depends on the circumstances as expressed in parameters. These, in 
turn, could change with the years on factors such as weather and climate, etc. 

In all the simulations we have shown, and many more that are not shown here, we 
note that according to the model presented, once mites have infested the colony, they 
stay there and cannot be fought off. 

In the next simulations that we show, we introduce at initial time a virus in the 
population; that is, we assume that m(0) » 0. This is illustrated in Figure 5.6. The brood 
maintenance coefficient was set to K= 8,000 (spring, autumn), K= 12,000 (summer), 
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FIGURE 5.4 Simulation of bee—mite population dynamics: periodic solutions for varying 


brood maintenance coefficients K, low K (a), (b) versus high K (c), (d) values, without mites 


(a), (c) and with mites (b), (d). 
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FIGURE 5.4 (continued) 


for varying brood maintenance coefficients K, low K (a), (b) versus high K (c), (d) values, 


without mites (a), (c) and with mites (b), (d). 
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FIGURE5.5 Simulation of bee—mite dynamics: disappearing bee colonies due to mites. 
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FIGURE 5.5 (continued) Simulation of bee—mite dynamics: disappearing bee colonies 
due to mites. 
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FIGURE 5.6 Simulation of the bee—mite—virus complex: In panel (a), the bee colony van- 


ishes in the sixth year after the virus is fully established; in panel (b), with strongly reduced 


parameter a, the virus is fought off. 
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K 26,000 (winter), and « as in Figure 5.4. Under these conditions, in the absence of 
the virus, we would find bees and mites attaining a coexistence pattern (simulation 
data not shown) similar to that in Figure 5.4b and d. With the virus included, we 
observe that initially bees and mites attain a coexistence pattern. However, in the 
sixth year, the colony vanishes abruptly and somewhat surprisingly. This coincides 
with, and is a consequence of, a steep increase in the number of virus-carrying mites. 
Indeed, upon closer inspection, we note that the maximum strength of the bee colony 
in summer decreased slightly every year as did the minimum strength in winter. We 
repeat this simulation with the strongly reduced, more or less unrealistic, «=0.1 for 
all seasons. Under these conditions, the virus can be fought off by the bee colony and 
bees and virus-free mites attain a periodic, stable pattern. 

Our simulations seem to suggest that it depends on the environmental and eco- 
logical conditions, as expressed in the model parameters, whether the virus disease 
can be eradicated or whether it will lead to the disappearance of the bee colony. 


5.5.3 MATHEMATICAL ANALYSIS OF THE CONSTANT COEFFICIENT CASE IN AN 
ATTEMPT TO GAIN Mont INSIGHT INTO COMPUTER SIMULATIONS 


As a four-dimensional, nonautonomous, nonlinear system of ordinary differential 
equations, models (5.1) through (5.4) are algebraically too involved to establish, with 
rigorous mathematical techniques, conditions on model parameters that allow the 
prediction of the fate of the colony. However, in order to explain and describe in more 
detail the interaction of bees, mites, and viruses, it is helpful to study the models for 
constant coefficients, which, for example, can be understood as investigating the 
seasons individually. 

The mathematical techniques used for this purpose are relatively well developed 
and described in many textbooks in mathematical biology (see, e.g., [22]). In short, 
we determine the steady states (equilibria points) of the underlying model and inves- 
tigate their linear stability. We say an equilibrium is asymptotically stable if solu- 
tions close to equilibrium converge to equilibrium. We say it is unstable if solutions 
close to equilibrium are repelled by equilibrium. Unstable equilibria are difficult 
to observe and usually not attained (unless they are already starting conditions). 
This stability analysis is performed by linearizing the equation about the equilib- 
rium and studying the behavior of solutions close to the equilibrium. The stability 
of an equilibrium is then obtained from the eigenvalues of the linearization matrix, 
the Jacobian. 

We advance in three steps. First, we investigate the simple submodel with bees 
only (without mites and viruses). Second, we also consider mites but not viruses, and 
finally we consider bees, mites, and viruses together. We summarize here the result 
only and refer the reader to Ratti et al. [23] for the mathematical details. 


5.5.3.1 One-Dimensional Healthy Bee Submodel 
In the absence of parasites and viruses, models (5.1) through (5.4) become 


— = HO(x)— dx 6:7) 
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with g(x) as in (5.6) for the brood maintenance function. Now u, K, d; are assumed 
to be constant. 

The dynamics of one-dimensional autonomous systems is structurally simple: 
either the solutions converge to an asymptotically stable equilibrium or they diverge 
to (positive or negative) infinity. 

The trivial equilibrium X; = 0 (no bees) exists always and is asymptotically stable. 
The unconditional stability of the trivial equilibrium reflects that a certain number of 
honey bees are required to care for the brood. 

Two other nontrivial equilibria X; > 0 and x > 0 exist if the maximum growth 
rate u is large enough, compared to the death rate d,. More specifically, after some 
routine algebra, the condition for the existence of these equilibria is obtained as 


— KQn-1 (5.8) 
n-1 
that is, it depends also on the brood maintenance coefficients, that is, the number of 
bees required to care for the brood. 

We denote the larger of the two equilibria by X; and the smaller one by X». The 
latter is unstable, while the former is asymptotically stable. 

Because the solution x(t) of (5.7) must be strictly monotonic between two equilib- 
rium points, we obtain the following picture: If initially the bee population is small, 
X(0) < x, the solution converges to the trivial equilibrium X; that is, the colony dies 
out because too few worker bees are present to care for the brood. On the other hand, 
if X(0) > X, the solution converges to the asymptotically stable equilibrium X; that 
is, a healthy colony can establish itself attaining equilibrium X. For the data in Table 
5.1, the nontrivial equilibria X3 exist in spring, summer, and fall, but not in winter, 
when no new bees are born. Thus, in winter, all solutions converge to the trivial 
equilibrium. However, as it is not reached in finite time, the population can recover 
in spring if at the beginning of the season the bee population is stronger than the 
equilibrium X obtained for that season. In the time-dependent computer simulations 
that were shown earlier, this corresponds to the situation found in Figure 5.4a and c. 


5.5.3.2. Two-Dimensional Bee-Mite Submodel 

We investigate now how the stability of the equilibria X012 of (5.8) changes when 
parasitic mites (but not viruses) are considered in the colony. To this end, we study 
the bee—mite subsystem of (5.3) and (5.4): 


g(x) (x) 69 
dM M 
Mm (1-2) (5.10) 


Here, we again assume (5.6) for the brood maintenance function g(x). 
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The two-dimensional model (5.9) and (5.10) can have up to five equilibrium points, 
that is, points (x°, M") for which dx/dt = dM/dt = 0. See Figure 5.7. 

The first one is again a trivial equilibrium point A with (x^, M*)=(0,0) (no bees, 
no mites), which can be shown to be always asymptotically stable, for the same rea- 
sons that X; was stable in the one-dimensional bee-only model and because in the 
absence of bees mites do not have a host. Solutions that come close enough to this 
equilibrium will lead to the dying out of both bees and mites. This corresponds to 
our dynamic computer simulations in Figure 5.5b through d. 
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FIGURE 5.7 Nullclines and location of equilibria for the bee—mite model (5.9) and (5.10): 
Shown are the dashed curves along which dM/dt=0 and the solid curves along which dx/dt=0. 
The equilibria are the intersections of a dashed and a solid curve. (a) The trivial equilibrium 
A is the only equilibrium; (b) only the mite-free equilibria A, B, C exist; (c), (d) two additional 


equilibria D, E with M*—ax'»0 exist. In (c) X < Xand in (d) X > x= Yn-1K. 
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FIGURE 5.7 (continued) 


Furthermore, it is easy to verify that if (5.8) is satisfied, then there exist two mite- 
free equilibrium points, associated with the two equilibria X2 of the aforementioned 
bee-only model: B : (6,0) and C : (%,0). The former inherits the instability of X» its 
phase portrait is an unstable node. The latter is an unstable saddle: only solutions on 
the line M=0 (no mites in the system) approach the equilibrium; all other equilibria 
are repelled. The instability of these mite-free equilibria is explained as follows: The 
growth of the mites is logistic. Therefore, as soon as mites enter the system, they 
start establishing themselves. That explains why in our computer simulations of the 
model we cannot find a case where the mites are fought off by the bees. 

Depending on parameters, there might also be two equilibria points D : (X5, M5) 
and E:(x¢,Me) for which both Xo; andMp,e are positive. Here, we have 
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Xp < X: and M5 < Me. Using phase plane analysis techniques, we find that the equi- 
librium D is always unstable, while E is stable if X > (/n—1 K and unstable other- 
wise. See [23] for the mathematical details. The simulations in Figure 5.4b and d 
correspond to stable E. 


5.5.3.3 Complete Bee-Mite-Virus Model 


We investigate now the question whether a stable, mite-infested honey bee colony 
can fight off the virus. To this end, we consider the complete four-dimensional 
models (5.1) through (5.4) with (5.6). It is easily verified that the equilibrium E of the 
bee-mite model has a corresponding disease-free equilibrium E4 : (xc, 0, Mz, 0). Of 
particular interest is the case where the equilibrium E is stable under (5.9) and (5.10). 
Linearization of (5.1) through (5.3) around this equilibrium shows that it is asymp- 
totically stable if the following condition on the parameters is satisfied: 


BPa < Bo [ ds vox) 6.11) 


Therefore, if the virus is introduced into a properly working mite-infested colony, 
the colony can fight off the virus if the sick bees die fast. This corresponds to the 
scenario we observed in our simulations in Figure 5.6b. However, as we have seen 
there, this required a relatively low choice for the parameter o, and, therefore, our 
results suggest that it might not be a frequent event that a colony can rid itself of the 
ABPV disease. As this equilibrium is the only stable equilibrium with a positive bee 
population size, the alternative seems the complete decline of the bee colony. 


5.6 CONCLUDING REMARKS 


In recent years, mathematical models have been successfully used to study the pro- 
gression of infectious diseases. While typically set in the context of human popu- 
lations, many of the principles are generally valid and can be applied to animal 
populations as well. In this chapter, we try to show how this is done for honey bee 
diseases in a simple example, focusing on honey bees, varroa mites, and the ABPV. 
This model, although conceptually simple, is complicated enough to not allow for 
a complete, rigorous mathematical analysis. Therefore, it must be studied in com- 
puter simulations, aided by analytically obtained mathematical insight. The model 
we describe here is but a first step from which many potential directions for further 
work originate. This includes more detailed descriptions of the disease, incorpora- 
tion of effects such as queen failure or swarming, which we neglected, or the effect 
of mite control strategies on the viral disease. 
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ABSTRACT 


Urban environments provide suitable habitats for feral honey bees, especially in 
the desert Southwest where urban areas may provide a more continuous supply 
of floral resources than surrounding natural areas. Studying honey bees in urban 
environments can be challenging due to logistical constraints, but health and safety 
concerns about Africanized honey bees have made understanding the urban ecology 
of honey bees increasingly important. We describe two data sources for Africanized 
honey bees in the greater Tucson metropolitan area. The first dataset consists of 
honey bee colony and swarm removals from 1994 to 2001 compiled from the records 
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of a company specializing in Africanized honey bee control. The second dataset 
contains removal data from water meter boxes from 1996 to 2008 based on water 
company records. The first dataset represents point data, whereas the second data- 
set represents lattice/grid data. We discuss approaches for analyzing these differ- 
ent types of spatial data using these datasets as examples. We use the first dataset 
to evaluate spatiotemporal patterns in the distribution of Africanized honey bees 
and the contribution of precipitation to those patterns. We use the second dataset to 
identify characteristics associated with Africanized honey bee occupancy of water 
meter boxes. The two datasets combined provided over 14,000 records of colony 
and/or swarm removals for the study area. We found that after Africanized honey 
bees became established, colony removals were clustered in space and time. We also 
identified winter precipitation as a good predictor of the number of honey bee remov- 
als, with colony and swarm removals increasing following a wet winter. Water meter 
boxes in residential locations were more likely to be occupied than those in commer- 
cial locations. Occupancy was also associated with smaller lots, older structures, and 
closer proximities to vacant land. Water meter boxes were more likely to be occupied 
if neighboring water meter boxes had been occupied. The spatial analysis of these 
two nontraditional sources of data provided important insights into the biology and 
ecology of feral honey bees in the greater Tucson metropolitan area, with implica- 
tions for developing control strategies for Africanized honey bees. 


KEYWORDS 


Apis mellifera, Cross-correlation, Feral colonies, Logistic model, Mantel test, 
Poisson model, Sonoran Desert, Swarms. 


6.1 INTRODUCTION 


This chapter focuses on the spatial ecology of feral honey bees in urban land- 
Scapes. We have extensive experience conducting research on various aspects of 
Africanized honey bee biology [1-12], with our more recent research addressing 
the distribution and abundance of feral colonies in urban landscapes [1,6]. This 
research has concentrated on two unique datasets encompassing the greater Tucson 
metropolitan area. The first dataset consists of data collected on honey bee colony 
and swarm removals from the invoices of a pest control company specializing in 
the removal of honey bee colonies and swarms [6]. The second dataset consists of 
data on the removal of Africanized honey bee colonies from water meter boxes 
by the Tucson Water Department, which covers most of the greater Tucson met- 
ropolitan area [1]. We provide a brief overview of the spatial aspects of honey bee 
colonies, followed by a review of what is known about the spatial distribution of 
feral colonies. We then discuss approaches for studying the spatial ecology of feral 
honey bees in urban landscapes, using the two datasets as examples. We specifi- 
cally focus on spatiotemporal patterns in the distribution of feral honey bee colo- 
nies and swarms and on identifying landscape characteristics associated with their 
occurrence. We discuss the results in the context of understanding the ecology of 
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feral honey bees in urban landscapes and the application of the results for develop- 
ing control strategies for Africanized honey bees and reducing human-honey bee 
interactions. We also discuss additional considerations and future directions for 
research using similar, nontraditional data sources. 


6.2 SPATIAL ASPECTS OF HONEY BEE COLONIES 


Honey bee (Apis mellifera L.) colonies are spatially organized in numerous ways. 
The hive itself contains distinct spatial patterns in the structure of the comb and the 
distribution of brood, pollen, and honey [13-15]. Colonies consist of thousands of 
bees that are divided into castes and distributed throughout the hive according to 
task, with spatial structure within the hive potentially contributing to task special- 
ization [16]. The implementation of tasks typically incorporates spatial information 
as well. For example, scout bees recruit worker bees to pollen and nectar sources 
by performing dances that provide information about the distance and direction 
of floral patches [17-19]. Spatial information is also used in the selection of nest 
sites. Honey bees reproduce at the colony level by swarming, where a portion of 
the colony leaves and forms a new colony. Honey bee swarms send out scouts to 
investigate potential nest sites based on a variety of factors, such as cavity size, 
entrance size, orientation, exposure, evidence of previous use, etc. [20—23]. The 
scout bees return to the swarm and perform waggle dances, which provide informa- 
tion about the distance and direction of potential nest sites. Nest site choice is nar- 
rowed down as additional scout bees recruit to advertised nest sites, until a single 
nest site option remains [22]. Nest site selection also likely reflects the suitability 
of broader-scale components of the surrounding environment for feral honey bee 
colonies, such as nectar and/or pollen availability or water resources. This chapter 
focuses on approaches for quantifying the spatial distribution of feral honey bee 
colonies and identifying landscape level features associated with the distribution 
and abundance of colonies and/or swarms. 


6.3 FERAL HONEY BEES 


Feral honey bees occur in many different habitats, such as coastal prairie [5], semi- 
deserts/deserts [24—27], forests [7,28,29], and urban areas [1,6,30,31]. Many studies 
have recorded the spatial locations of feral colonies, with some estimating colony 
density and others identifying environmental characteristics associated with colony 
locations [1,5,6,13,25,26,28—30,32—-40]. However, relatively few studies have evalu- 
ated spatial and/or temporal patterns in the distribution of feral honey bee colonies 
[1,5,6,25,33,34,40] or identified landscape characteristics associated with nest sites 
[1]. The loss of many managed honey bee colonies to colony collapse disorder [41,42] 
and the arrival of Africanized honey bees, hybrids between European and African 
(A. m. scutellata) honey bees [11,43], have increased the need for more information 
about feral honey bee populations [44,45], especially in terms of understanding fac- 
tors influencing the spatial and temporal distribution of feral colonies. With fewer 
managed colonies available to provide pollination services to agricultural crops and 
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native plants, more data are needed on the distribution and abundance of feral colo- 
nies and their potential contribution to pollination. Furthermore, data on spatial and 
temporal distribution patterns can provide useful information for developing strate- 
gies for controlling and managing Africanized honey bees, as well as for controlling 
and managing honey bee parasites and diseases that show spatial and/or temporal 
patterns of infection [46,47]. 

Several studies have identified aggregations (i.e., clumped distributions) of honey 
bee colonies in different locations, including Australia [33,34]; Botswana, Africa 
[25]; southern Texas, United States [5]; and Tucson, Arizona, United States [1,6]. 
Aggregations have also been documented for other honey bee species, including 
giant honey bees (A. dorsata Fabricius and A. laboriosa Smith) [48—50] and dwarf 
honey bees (A. florea Fabricius and A. andreniformis Smith) [40,51]. Several bio- 
logical and/or ecological reasons have been proposed for why colonies may form 
aggregations [33,40,52]. For example, short swarm dispersal distances may lead to 
aggregations, whereas long dispersal distances may lead to other distribution pat- 
terns. However, reports of swarm dispersal distances are variable, with both rela- 
tively short and long dispersal distances reported [33,53—58]. These conflicting 
results may reflect the influence of site-specific characteristics on swarm dispersal 
distances, such as differences in resource availability or genetic differences among 
populations [54,59]. For example, swarms may select nearby cavities when cavities 
are abundant and disperse longer distances when cavities are scarce [20,55—57]. Also, 
Africanized honey bee swarms have been recorded dispersing farther than swarms of 
European origin [54,59]. Other potential benefits of aggregations include increased 
predator detection and/or defenses and increased mating efficiency [40,50,52,60]. 
Alternatively, swarms may select nest sites near existing colonies if the presence of 
colonies is used by the honey bees as an indicator of environmental suitability, such 
as high floral resource availability [33.40,50], or if swarms employ similar behav- 
ioral rules and make similar decisions during the process of evaluating potential nest 
sites [40,61]. Potential disadvantages of aggregations include the attraction of preda- 
tors, increased transmission of pests and/or pathogens, and competition for floral 
resources [40,46,47,50]. Therefore, identifying spatial and temporal patterns in the 
distribution of honey bee colonies and identifying landscape characteristics associ- 
ated with these patterns can provide a framework for evaluating potential biological 
and ecological mechanisms behind aggregations, as well as developing additional 
hypotheses to explain these patterns. 

We have studied the spatial distribution of feral honey bee colonies in natural 
and urban settings [1,5,6] using different types of spatial data, including point 
data and lattice data. Point data consist of spatial coordinates for colony loca- 
tions, which can be recorded using global positioning system (GPS) technology 
[5] or by assigning coordinates to street addresses where colonies have been 
recorded [6]. In the latter case, street addresses can be linked to line segments 
in a street network coverage using a commercial geographic information system 
(GIS) product to generate address-specific spatial coordinates. Lattice data con- 
sist of data associated with a lattice or grid, where a data point is recorded for 
each grid cell. Lattice data could be obtained in many ways, such as placing a 
trap within each grid cell for sampling. Depending on the question of interest, 
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separate analyses of spatial locations may be needed for colonies and swarms, 
since colonies represent the selection of somewhat permanent nest site locations 
and swarms only occupy temporary locations while in the process of selecting a 
more permanent nest site. 


6.4 APPROACHES FOR STUDYING THE SPATIAL ECOLOGY OF 
FERAL HONEY BEE COLONIES IN URBAN LANDSCAPES 


A variety of approaches can be used for studying the spatial ecology of honey bees. 
We focus our discussion on approaches relevant for feral honey bee colonies and/or 
swarms, with an emphasis on urban landscapes. We start by describing two nontradi- 
tional datasets on feral honey bees in the greater Tucson metropolitan area. We then 
explain different approaches for evaluating the spatial ecology of feral colonies and/ 
or swarms, providing an example of how each approach can be applied using these 
datasets. 


6.4.1 DESCRIPTION OF DATASETS 


Our research on feral honey bees in urban settings has focused on two unique datas- 
ets encompassing the greater Tucson metropolitan area (Figure 6.1). The first dataset 
consists of data collected on honey bee colony and swarm removals from 1994 to 
2001 from invoices obtained from a pest control company specializing in the removal 
of honey bee colonies (BeeMaster, Inc.; [6]). The second dataset consists of data on 
the removal of Africanized honey bee colonies from water meter boxes from 1996 
to 2008 from records provided by the Tucson Water Department, which covers most 
of the greater Tucson metropolitan area [1]. Both datasets indicate that honey bee 
colonies were rarely found in water meter boxes or other urban cavities until after the 
arrival of Africanized honey bees. For example, only 14 colonies and swarms were 
removed by BeeMaster, Inc. in 1994, the year after Africanized honey bees were first 
recorded in Arizona, compared to a minimum of 458 colonies and swarms recorded 
in subsequent years [6]. Africanized honey bee colonies are typically smaller than 
colonies composed of bees of European origin, and they will use smaller cavities and 
a wider range of nest sites, including water meter boxes, garbage cans, flower pots, 
etc. [23,62—64]. This reduced selectivity in nest site selection (compared to European 
honey bees) could place Africanized honey bees in closer proximity to humans [1,6]. 
This may be especially true in southeastern Arizona (and the greater Tucson metro- 
politan area) where cavities are relatively uncommon in natural areas where colonies 
nest in rock crevices [29,55]. Combined with their stronger defensive behaviors, these 
characteristics raise concerns about the interactions between Africanized honey bees 
and humans. Furthermore, feral honey bee colonies in areas of the United States 
dominated by Africanized honey bees are primarily Africanized [10,63], including 
the greater Tucson metropolitan area in Arizona [65,66]. 

For the pest removal dataset, we collected data from the invoices of a pest control 
company (BeeMaster, Inc.), including the dates and street addresses for colony and/ 
or swarm removals [6]. We converted each street address into spatial coordinates 
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by linking each address to line segments in the Pima County Department of 
Transportation street network coverage using ArcGIS?. Therefore, the pest removal 
dataset represents point data because it is based on specific spatial locations where 
honey bee colonies and/or swarms were removed. The dataset is limited by socio- 
economic constraints, as the data depend on the ability and/or willingness to pay for 
honey bee removal services. The dataset is also limited by colony and swarm detect- 
ability, which could vary based on numerous social, economic, and environmental 
considerations [6]. However, we expect these biases are minimal in the study area 
because of public concern about Africanized honey bees (aka "killer bees"). 

The water meter dataset also represents point data because it is based on records of 
water meter boxes from which colonies were removed. We converted these data into 
lattice data by adding locations of water meter boxes where honey bee colonies were 
not recorded from records available from the Pima County Tax Assessor's Office. 
Because water meter boxes are checked regularly for billing purposes, this additional 
information allowed us to incorporate both presence and absence data. These data are 
necessary for identifying landscape characteristics associated with the occurrence 
of honey bee colonies and to predict where honey bee colonies will likely be found. 
We made several necessary assumptions about the dataset. First, we assumed the 
dataset was complete and that all colonies were recorded and removed by the water 
company (i.e., no one else found and removed colonies between water meter checks). 
We also assumed that water meter boxes were checked once every 30 days and that 
no new colonies occurred within that 30-day time period. Finally, we assumed that 
water meter boxes were checked regularly after the construction date for a building, 
although water meters may have been turned off for various amounts of time or not 
turned on until after the construction date. An additional limitation of this dataset 
relates to the uneven distribution of water meter boxes throughout the greater Tucson 
metropolitan area. Furthermore, the availability of other types of cavities and their 
relative suitability for honey bee colonies may have varied throughout the study area. 
However, we expect cavity availability to be high throughout the study area and that 
cavities are not limiting for honey bees, especially given the diversity of nest sites 
used by Africanized honey bees [23,62,64,66]. Regardless of these limitations, the 
water meter dataset provides a unique perspective on the spatial ecology of feral 
honey bees because it simulates an array of traps distributed across the study area, 
which were checked monthly for honey bee colonies [1]. 

The pest removal dataset indicated that colony and swarm removals in the greater 
Tucson metropolitan area typically exhibited a bimodal intra-annual distribution with 
peaks in March through May and again in October (Figure 6.2). Some years (e.g., 
1995, 1996, 1997, and 2001) exhibited both peaks in activity, whereas some years 
showed only an early peak (e.g., 1999, 2000) and others showed a pronounced late 
peak (e.g., 1998). Colony and swarm removals also showed pronounced fluctuations 
among years. For example, the number of swarms removed increased from 1995 to 
1996 (44196), 1997 to 1998 (423096), and 2000 to 2001 (4-336906), and decreased 
from 1996 to 1997 (—10%), 1998 to 1999 (—1096), and 1999 to 2000 (—49%). Similar 
patterns were observed for the water meter dataset over the same time period. 
Most water meter boxes were located in residential areas (8296) and most water 
meter boxes occupied by honey bee colonies occurred in residential areas (87%). 
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Overall, less than 3% of the water meter boxes in any given land use type (e.g., 
residential, commercial/public, recreation, agriculture, etc.) ever contained a honey 
bee colony, and only 1.2896 of the water meter boxes in the overall study area. Over 
the 12-year study period, 8,211 colonies were removed from 5,640 water meter 
boxes, with an average of 632 colonies removed per year. Of the occupied water 
meter boxes, 1,350 were occupied more than once over the 12-year study period. 


6.4.2 OVERVIEW OF ANALYTICAL APPROACH 


Although working with nontraditional datasets (i.e., data not collected from a 
designed study) generates many challenges, they provide a unique opportunity to 
increase our understanding of feral honey bees in urban landscapes. We used the pest 
removal dataset to evaluate spatiotemporal patterns in the distribution of feral honey 
bee colonies and swarms using a Mantel test. We used a cross-correlation analysis 
to evaluate the contribution of precipitation to the observed patterns. We developed 
logistic and Poisson models to identify landscape characteristics that contribute to 
the nest site locations of feral honey bee colonies using the water meter dataset. The 
results of these analyses provide insight into the ecology of feral honey bees in urban 
landscapes and also suggest potential control strategies for Africanized honey bees 
in urban areas. 


6.4.3 SPATIOTEMPORAL PATTERNS 


A Mantel test can be used to evaluate the similarity or dissimilarity between two 
distance matrices [67], including distance in space and distance in time. If distance 
units are not comparable (as is the case with space and time units), the data can be 
ranked prior to analysis [13,68]. A randomization test (i.e., random reshuffling of the 
data values) is typically used to evaluate if values are significant, with significance 
occurring when the Mantel test statistic is more extreme than the randomly generated 
reference distribution as determined by Spearman's rank correlation coefficient. We 
used a Mantel test to evaluate if honey bee colony and swarm removals located close 
together in space were also located close together in time in the pest removal dataset 
[6]. We found that during the initial years following the arrival of Africanized honey 
bees (i.e., 1995-1998), colony locations and a combination of colony and swarm 
locations were not spatiotemporally aggregated (Table 6.1). However, significant 
spatiotemporal clustering occurred during the last 3 years for which data were avail- 
able (i.e., 1999—2001). During 1999 and 2000, colony and swarm removals tended 
to be locally concentrated, with removals located close together in space also being 
located close together in time. These years were also dry years, and there was a pro- 
nounced decline in the number of colonies and swarms removed from 1999 to 2000. 
In 2001, which was a wet year, approximately 3x as many colonies and swarms were 
removed compared to the previous year. Removals were also broadly distributed 
throughout the greater Tucson metropolitan area (i.e., spatiotemporal clustering was 
negative). The extreme variation in the number of colonies and swarms removed 
among years suggests that climatic conditions may contribute to inter- and intra- 
annual fluctuations in the size of the feral honey bee population. 
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TABLE 6.1 

Mantel Test Results to Evaluate if Colony Removals or Colony and 
Swarm Removals Located Close together in Space Were also 
Located Close together in Time for the Pest Removal Dataset 


Year # Colonies R p # Colonies and Swarms R p 

1994 14 -0.071 0.376 14 -0.071 0.376 
1995 323 0.009 0.286 458 0.004 0.385 
1996 474 0.011 0.187 665 0.009 0.203 
1997 445 0.022 0.096 617 0.021 0.075 
1998 1,012 0.019 0.061 1,407 0.017 0.051 
1999 871 0.027 0.036 1,225 0.025 0.024 
2000 333 0039 0.021 525 0.046 0.005 
2001 1,035 —0.029 0.009 1,613 —0.033 0.000 


Source: Modified from Landscape Urban Plann., 85, Baum, K.A., Tchakerian, M.D., 
Thoenes, S.C., and Coulson, R.N., Africanized honey bees in urban environ- 
ments: A spatio-temporal analysis, 123-132, Copyright [2008], with permission 
from Elsevier. 


Temperature and precipitation may influence the distribution of Africanized 
honey bees. However, Tucson is in southeastern Arizona in the northern Sonoran 
Desert. Therefore, it is unlikely that winter temperatures would limit the distribu- 
tion of Africanized honey bees in the study area. However, honey bees depend on 
floral resource availability, which may be limited by precipitation. Average annual 
rainfall in this area is 29.7 cm, with rainfall events concentrated during the summer 
monsoon period (July to mid-September) and to a lesser extent during the winter 
(December to early March). Therefore, nectar and pollen availability are relatively 
high in natural areas in the spring and later summer/fall [69,70] and lower through- 
out the remainder of the year. African honey bees are adapted to rapidly exploit the 
seasonal flushes of floral resources that occur in tropical habitats and are expected 
to respond more strongly to precipitation patterns than European honey bees, 
which are adapted to exploit the more consistently available floral resources of 
temperate habitats [66,71,72]. However, floral resource availability may be higher 
in urban areas where landscaping (including the use of exotic ornamentals) and 
associated irrigation may extend flowering periods. Therefore, urban environments 
may provide a more spatially and temporally consistent supply of floral resources 
compared to surrounding natural areas (as well as more abundant cavities; see ear- 
lier text). Also, floral resource availability is not expected to be directly correlated 
with precipitation, as there is typically a time lag between precipitation events and 
flower production. 

A cross-correlation analysis provides a useful approach for evaluating the rela- 
tionship between colony and swarm removals and climatic conditions across a range 
of time lags. Cross-correlation values range from -1 to 1. When strong positive 
correlation occurs, cross-correlation values approach 1, and when strong negative 
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correlation occurs, values approach -1, with 0 indicating the absence of correlation. 
Significance is evaluated using 9596 upper and lower confidence limits. We used a 
cross-correlation analysis to evaluate the contribution of precipitation to the abun- 
dance of colonies and swarms in the pest removal dataset using daily precipitation 
data. Colony removals were positively cross-correlated with precipitation in 1997, 
1998, and 2001 and negatively correlated in 1996 and 1998 (Figures 6.2 and 6.3). 
Swarm removals were positively cross-correlated with precipitation in 1997, 1998, 
2000, and 2001 and negatively cross-correlated with precipitation in 1998 (Figures 
6.2 and 6.3). Relatively short lag times likely reflect frequent rainfall and high or 
early pollen availability, whereas longer lag times likely reflect low or delayed pol- 
len availability. For example, 1998 was an El Nifio year and the wettest year based 
on overall precipitation, and colony and swarm removals showed relatively short, 
positive lags (15 and 12 weeks, respectively), suggesting pollen availability was high. 
Furthermore, 1998 also had the greatest number of days with rain, with colony and 
swarm removals also exhibiting very short, negative lags (4 and 0 weeks, respec- 
tively), as would be expected with a temporary decrease in honey bee activity asso- 
ciated with rainfall. Lag times in 1997 were intermediate in length (e.g., 31, 32, and 
34 weeks for colony and swarm removals) and long in 2001 (28-30 weeks for colony 
removals and 24, 26, and 28 weeks for swarm removals), suggesting intermediate 
and low levels of pollen availability, respectively. Lag times for colonies and swarms 
would be expected to be similar, given that colony activity levels are expected to 
be high during periods of high pollen availability, which would also correspond to 
swarm production. These high levels of activity would increase the likelihood of 
detection (and thus inclusion in the pest removal dataset), depending on the cavity 
selected, and the timing would likely be associated with the developmental periods 
of honey bees. 

In the greater Tucson metropolitan area, spring flowering (and swarming activity) 
is associated with rainfall arriving late in the previous year [55]. To identify expected 
periods of swarming activity, it is necessary to consider the developmental periods 
of honey bees. For European honey bees, worker bees develop in approximately 21 
days and queens in about 18 days. Africanized honey bees develop 1—2 days faster 
than European honey bees. Therefore, one would expect early spring swarming to 
occur approximately 24—26 weeks after precipitation in October that generates early 
spring flowering in mid-February (which would correspond to 6—8 weeks after early 
spring flowering begins). Precipitation during the growing season would be expected 
to generate shorter lags, as floral resources (and subsequently honey bees) would 
exhibit a more immediate response. Negative correlations could be associated with 
detection probabilities, with the expectation that fewer swarms and colonies would 
be detected and/or removed during rainy periods when honey bees are less active 
(and less likely to be noticed) and people may spend less time outside. Positive cor- 
relations also would be associated with detection probabilities and related to activity 
periods of honey bees and humans. Seasonal absconding could obscure these pat- 
terns if colonies leave their nests in areas of low resource availability (common in 
the mountains surrounding Tucson during the fall and winter; [73]) in search of nest 
sites with more suitable conditions, such as areas where agricultural and landscaping 
practices increase floral resource availability [72-74]. 
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6.4.4 LANDSCAPE ASSOCIATIONS 


Landscape characteristics also can influence the distribution and abundance of feral 
honey bee colonies. We used the water meter dataset to evaluate the influence of 
land use, lot characteristics, and structure characteristics on the spatial distribution 
of feral honey bees in the greater Tucson metropolitan area [1]. We developed logis- 
tic regression and Poisson models to predict the occupancy of water meter boxes 
based on landscape characteristics (i.e., distance to different land use types based 
on distance to nearest edge) and lot/structure characteristics (i.e., construction year, 
lot size, and indicator variables for the presence of a swimming pool within 0.8 km 
and the presence of a residential location) (Table 6.2). Indicator variables are binary 
variables, receiving a value of 1 when the indicator is present and a value of 0 when 
it is not present (e.g., a value of 1 when the location was a residential location and 
a value of 0 when the location was not a residential location). We also included the 
percent occupancy of nearby water meter boxes, which was calculated as the percent 
of water meter boxes within 0.8 km of a given water meter box that were occupied 
at least once during the 12-year study period (Table 6.2). This distance was selected 
to represent typical foraging distances and swarm dispersal distances based on data 
reported in the literature [53,55,58,75]. In both models, the location (i.e., landscape 
characteristics) of every water meter box in the study area was used to identify the 
variables that could influence water meter box occupancy by feral honey bee colo- 
nies. Therefore, an unbiased analysis of factors most relevant to colony occupancy 
required that the colony removal dataset (positive counts only) be combined with a 
dataset including the locations (and landscape characteristics) of all the water meter 
boxes in the study area, many of which were never occupied. For both the logistic 
and Poisson models, this generated a dataset of 275,877 data points. In the case of 
the logistic model, we used a binary variable (1 or 0) to indicate whether a water 
meter box was ever occupied by a honey bee colony. Thus, the quantity estimated 
from the model can be interpreted as the probability of the water meter box being 
occupied over the 12-year study period. For the Poisson model, we used a similar 
approach to regress the landscape characteristics of each water meter box location 
against the number of times, over the 12 year x 1 month sampling period, that the 
water meter box was occupied. Therefore, the output of the model is a Poisson rate 
that can be used to assess a probability that a given number of occupancies will 
occur in a given water meter box (dependent on its landscape characteristics) over the 
12 year x 1 month sampling period. 

In practice, both models were developed by calculating a large number of potential 
independent variables (i.e., landscape characteristics) and then assessing the significance 
of each variable when included in either the logistic regression or Poisson models. This 
stepwise approach to model development contributes to the ecological interpretation of 
results. Although it is not reasonable to expect that landscape characteristics alone can 
predict feral honey bee colony occurrence (e.g., many other nonlandscape or smaller 
scale factors may also influence colony nest site selection), the stepwise procedure 
allowed us to evaluate factors that we thought might influence feral honey bee colony 
behavior. It elucidated the significance of each potential variable, allowing us to identify 
those that do affect colony nest site location as well as eliminate those that do not. 
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TABLE 6.2 


Description of the Variables Included in the Logistic Regression and Poisson 
Models for the Water Meter Box Dataset, Including How Each Variable Was 
Measured, and Corresponding Means and Standard Deviations (SD) 


Variable Mean 


% Nearby water meter boxes 2.46 
with colonies 


Construction year 1976 


Lot size (ha) 0.466 


Distance from “water”? (km) 1.42 


Distance from recreational 3.73 
land (km) 

Distance from natural 2.42 
land (km) 

Distance from vacant land 1.44 
(km) 

Distance from agricultural 10.92 
land (km) 

Distance from transportation 1.36 
land (km) 

Indicator of pool within 0.737 
0.8 km 

Indicator of residential 0.821 
location 


SD 
2.47 


18.73 


0.383 


Description 


The percent of nearby water meter boxes within 
0.8 km that were occupied at least once over the 
12-year study period for every water meter box. 

The year the structure associated with a water 
meter box was built. 

The land area of a parcel of land associated with a 
water meter box. 

Distances calculated as the distance from the center 
of the lot associated with each water meter box to 
the nearest edge of the specified land use type. 


Binary variable for the presence or absence of a 
pool within 0.8 km (i.e., 1 indicates a pool is 
present and 0 indicates no pool is present). The 
mean is the percentage of water meter boxes with 
a pool within 0.8 km. 

Binary variable for residential location (i.e., 1 
indicates a residential location and 0 indicates a 
nonresidential location). The mean is the 
percentage of water meter boxes that were in 
residential locations. 


Source: Modified from Landscape Urban Plann., 100, Baum, K.A., Kolodziej, E.Y., Tchakerian, M.D., 
Birt, A.G., Sherman, M., and Coulson, R.N., Spatial distribution of Africanized honey bees in an 


urban landscape, 153-162, Copyright (2011), with permission from Elsevier. 


a Most lots classified as water only temporarily held water and were dry for part of the year; some were 


washes that only contained water during the monsoon season [78]. 
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Variables were either significant in both models or not significant in either model. 
Variables that were significant in both models included percent of occupied neigh- 
boring water meter boxes, construction year, lot size, distance from vacant land, and 
the indicator of residential location (Tables 6.3 and 6.4). Colonies were more likely to 
occupy water meter boxes associated with higher percentages of neighboring water 
meter boxes with colonies, older structures, smaller lots, closer distances to vacant 
land, and residential (versus commercial) locations. The importance of occupied 
neighboring water meter boxes supports the view that colonies tend to form aggrega- 
tions (see earlier discussion on the potential biological advantages and disadvantages 
of aggregations). Older structures likely provide more potential cavities, whereas res- 
idential locations may provide higher floral resource availability compared to other 
land use types based on urban landscaping practices [76], and residential locations 
tend to be located on smaller lots. 

Variables that were not significant in either model included distances from water, 
recreational land, natural land, agricultural land, and transportation land, as well 
as the indicator variable for a nearby swimming pool (Tables 6.3 and 6.4). These 
results suggest that water was not limiting in the study area. The distribution of the 


TABLE 6.3 

Parameter Estimates, Standard Errors (SE), and Two-Tailed P-Values 
from the Logistic Regression Model to Predict the Occupation of 
Water Meter Boxes 


Parameter Parameter Estimates SE P-Values 
(Intercept) 31.62 3.98 «0.0001* 
Percent neighbors with colonies 23.12 2.39 «0.0001* 
Construction year —0.018 0.002 «0.0001* 
Lot size [Ln(acres + 0.1)] 0.454 0.025 «0.0001* 
Distance from “water”? (km) 2.700e — 05 1.672e — 05 0.106 
Distance from recreational land (km) 1.305e - 05 2.051e — 05 0.525 
Distance from natural land (km) 1.485e - 05 1.076e — 05 0.168 
Distance from vacant land (km) —-1.110e — 04 1.902e — 05 «0.0001* 
Distance from agricultural land (km) —8.412e — 07 4.980e — 06 0.866 
Distance from transportation land (km) 2.605e — 05 1.358e — 05 0.055 
Indicator of pool within 0.8 km 0.020 0.051 0.690 
Indicator of residential location 0.184 0.057 0.001* 


Source: Modified from Landscape Urban Plann., 100, Baum, K.A., Kolodziej, E.Y., 
Tchakerian, M.D., Birt, A.G., Sherman, M., and Coulson, R.N., Spatial distribution of 
Africanized honey bees in an urban landscape, 153-162, Copyright (2011), with 
permission from Elsevier. 

Note: Parameter values with a P-value «0.05 are indicated with an asterisk. 

a Most lots classified as water only temporarily held water and were dry for part of the year; 

some were washes that only contained water during the monsoon season [78]. 
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TABLE 6.4 

Parameter Estimates, Standard Errors (SE), and Two-Tailed P-Values 
from the Poisson Model to Predict the Number of Times a Water 
Meter Box Was Occupied over the 12-Year Study Period 


Parameter Parameter Estimates SE P-Values 
(Intercept) 31.71 5.69 «0.0001* 
Percent neighbors with colonies 23.43 3.34 «0.0001* 
Construction year —0.018 0.003 «0.0001* 
Lot size [Ln(acres +0.1)] 0.503 0.039 «0.0001* 
Distance from “water”? (km) 2.529e — 05 2.523e — 05 0.316 
Distance from recreational land (km) 4.816e — 06 2.260e-05 0.831 
Distance from natural land (km) 1.909e-05 1.686e-05 0.258 
Distance from vacant land (km) —1.329e — 04 2.398e — 05 «0.0001* 
Distance from agricultural land (km) 2.087e — 06 7.540e — 06 0.782 
Distance from transportation land (km) 2.990e — 05 2.065e — 05 0.148 
Indicator of pool within 0.8 km 0.054 0.082 0.508 
Indicator of residential location 0.153 0.009 «0.0001* 


Source: Modified from Landscape Urban Plann., 100, Baum, K.A., Kolodziej, E.Y., 
Tchakerian, M.D., Birt, A.G., Sherman, M., and Coulson, R.N., Spatial distribution 
of Africanized honey bees in an urban landscape, 153-162, Copyright (2011), with 
permission from Elsevier. 

Note: Parameter values with a P-value «0.05 are indicated with an asterisk. 

* Most lots classified as water only temporarily held water and were dry for part of the year; 

some were washes that only contained water during the monsoon season [78]. 


different land use types could have contributed to their not being important pre- 
dictors of water meter box occupancy or multiple occupancies, with recreational, 
natural, and agricultural lands tending to be distributed around the periphery of the 
greater Tucson metropolitan area. Resource availability within these different land 
use types also could have contributed to the observed patterns. 

Overall, 2.4696 of nearby water meter boxes (within 0.8 km of any given water 
meter box) were occupied, and these occupations were concentrated in south central 
Tucson (Figure 6.4). High probabilities of occupancy and of multiple occupancies 
were concentrated in south central Tucson, with additional high probability occu- 
pancies occurring in several suburbs around the periphery of the greater Tucson 
metropolitan area (Figures 6.5 and 6.6). These patterns suggest that the feral honey 
bee population is either denser in this area or that more colonies are located in water 
meter boxes in this area. We expect that cavity sources are abundant in the greater 
Tucson metropolitan area [1,6] and that the population is denser in this area. A ten- 
dency to reuse previously used cavities could contribute to this pattern as well, which 
could be driven by a preference for previously used cavities [20], a tendency to form 
aggregations (see previous discussion), or by similar nest site selection criteria and/ 
or decisions [20—23]. 


Honey Bee Ecology from an Urban Landscape Perspective 127 


VILE 


Í Percent neighbors 


with colonies 


Kilometers 


FIGURE 6.4 (See color insert. Spatial distribution of percent of neighboring water 
meter boxes with colonies (within 0.8 km) for every water meter box in the water meter 
box dataset. (Modified and reprinted from Landscape Urban Plann., 100, Baum, K.A., 
Kolodziej, E.Y., Tchakerian, M.D., Birt, A.G., Sherman, M., and Coulson, R.N., Spatial dis- 
tribution of Africanized honey bees in an urban landscape, 153-162, Copyright [2011], with 
permission from Elsevier.) 


6.5 CONCLUSIONS, ADDITIONAL CONSIDERATIONS, 
AND FUTURE DIRECTIONS 


Our research on feral honey bees in urban landscapes has focused on two unique 
datasets developed from nontraditional sources. An analysis of the pest removal 
dataset revealed that colony and swarm removals were not spatiotemporally clus- 
tered after the initial arrival of Africanized honey bees in the study area. However, 
that pattern shifted in subsequent years, with positive spatiotemporal clustering in 
1999 and 2000 and negative spatiotemporal clustering in 2001. We identified winter 
rainfall as a good predictor of honey bee abundance in urban areas in the desert 
Southwest and a potential indicator of high human-honey bee interactions. An anal- 
ysis of the water meter dataset found that water meter boxes were more likely to be 
occupied when associated with residential locations, older structures, smaller lots, 
closer proximity to vacant land, and if nearby water meter boxes were occupied. 
Water meter box occupancies were concentrated in south central Tucson, suggesting 
this area is highly suitable for honey bees. Taken together, the results from these two 
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FIGURE 6.5 (See color insert. Spatial distribution of Africanized honey bee colony 
occupancy probabilities predicted by the logistic regression model for the water meter box 
dataset. Dark shaded areas show parts of the greater Tucson metropolitan area where water 
meter boxes are predicted to have high occupancy rates, whereas light shaded areas are pre- 
dicted to have low occupancy rates. (Reprinted from Landscape Urban Plann., 100, Baum, 
K.A., Kolodziej, E.Y., Tchakerian, M.D., Birt, A.G., Sherman, M., and Coulson, R.N., Spatial 
distribution of Africanized honey bees in an urban landscape, 153-162, Copyright [2011], 
with permission from Elsevier.) 


datasets suggest that control efforts should be focused in areas where colonies and/or 
swarms are found and that source colonies likely exist in south central Tucson. They 
indicate that control efforts should be increased following wet winters, when swarm- 
ing activity is likely to be high. The results also highlight the importance of the 
"capture" and removal of colonies in water meter boxes, which likely contributes 
significantly to the control of Africanized honey bees in the study area. 

For both datasets, we acknowledge that socioeconomic factors could have influ- 
enced the observed patterns [1,6]. The tolerance of stinging insects and perceptions 
about Africanized honey bees (aka "killer bees") could influence the likelihood of 
a homeowner or business owner choosing to remove a colony himself/herself or 
choosing to call a pest control company, as well as the ability to pay for honey 
bee removal services. Resource availability (e.g., pollen, nectar, water, nest sites, 
etc.) can vary with social and economic variables as well, with land use, family 
income, and housing age being predictors of plant diversity in the Central Arizona- 
Phoenix region [76,77]. These factors could also influence detectability, based on 
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FIGURE 6.6 (See color insert.) Spatial distribution of Africanized honey bee colony mul- 
tiple occupancy probabilities predicted by the Poisson model for the water meter box dataset. 
Dark shaded areas show parts of the greater Tucson metropolitan area where water meter 
boxes are predicted to have high multiple occupancy rates, whereas light shaded areas are pre- 
dicted to have low multiple occupancy rates. (Reprinted from Landscape Urban Plann., 100, 
Baum, K.A., Kolodziej, E.Y., Tchakerian, M.D., Birt, A.G., Sherman, M., and Coulson, R.N., 
Spatial distribution of Africanized honey bees in an urban landscape, 153-162, Copyright 
[2011], with permission from Elsevier.) 


the locations of honey bee resources and human behaviors and/or activities that 
can vary with socioeconomic considerations, such as the frequency of recreational 
activities focused in areas with resources shared with honey bees. Census data, 
such as population density, housing density, median household income, median 
house value, education level, and unemployment rate, could be used to provide 
insight into these factors. 

Itis also important to note that detection is important for the control of Africanized 
honey bees. For example, redesigning water meter boxes to restrict honey bee access 
could lead to an increase in the size of the Africanized honey bee population in the 
greater Tucson metropolitan area, especially if cavities are not limiting (which is 
likely the case up to a certain point) and fewer colonies are subsequently detected 
and removed. The implementation of smart meter programs also could influence 
these patterns if water meters are remotely monitored and water meter boxes are not 
checked on a regular basis. 
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Understanding the spatial ecology of feral honey bees can provide important 
insights into the biology and ecology of feral honey bees. Although each of our data- 
sets is accompanied by certain constraints and/or limitations, examining comple- 
mentary types of spatial data with the appropriate spatial techniques can expand our 
understanding of how feral honey bees respond to spatial and temporal variability 
in urban environments. Furthermore, our research identifies the importance of non- 
traditional sources of data for feral honey bees, which has important implications 
for urban ecological research in general, as well as developing strategies to control 
Africanized honey bees in urban areas. 
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FIGURE 1.6 Bee with an RFID tag glued to the back side of her thorax. (Reproduced with 
kind permission of Axel Decourtye, ACTA.) 


Day 1 Day 4 Day 7 Day 10 Day 12 Day 14 


FIGURE 3.2 Agent-based model of pattern formation during a period of high nectar 
intake. Honey cells are yellow, pollen cells are red, and brood cells are black. Initially, pollen 
is scattered throughout the nest, but once open brood is present, pollen accumulates at the 
bottom of the nest. Nectar shows an immediate bias toward being unloaded at the top of the 
nest due to the upward movement of nectar receivers. By day 7, the complete pattern is almost 
present with the exception of the pollen band, which forms by day 14. (From Johnson, B.R., 
Proc. Roy. Soc. B Biol. Sci., 2776, 255, 2009.) 
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FIGURE 3.3  Contrasting roles played by each mechanism underlying pattern formation. 
The pattern is shown at 14 days in each image. (a) The full model. (b) Without the queen- 
based template for unloading pollen near open brood, pollen is scattered throughout the 
honey zone. (c) Without differential removal of food from near the brood (the SO mecha- 
nism), the pattern is far from complete in that pollen does not localize and the sections 
of the nest are not distinct. (d) Without the recipe's effect of upward bias in unloading of 
nectar, the pattern is not vertical (honey on top brood on the bottom). (e) The original self- 
organization model of Camazine (differential removal of food from near brood alone) does 
not lead to complete pattern formation. (From Johnson, B.R., Proc. Roy. Soc. B Biol. Sci., 
2/16, 255, 2009.) 


Full model 


Cia VNU A 
Percent neighbors 
with colonies 


Kilometers 


FIGURE 6.4 Spatial distribution of percent of neighboring water meter boxes with colo- 
nies (within 0.8 km) for every water meter box in the water meter box dataset. (Modified 
and reprinted from Landscape Urban Plann., 100, Baum, K.A., Kolodziej, E.Y., Tchakerian, 
M.D., Birt, A.G., Sherman, M., and Coulson, R.N., Spatial distribution of Africanized honey 
bees in an urban landscape, 153-162, Copyright [2011], with permission from Elsevier.) 
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FIGURE 6.5 Spatial distribution of Africanized honey bee colony occupancy probabili- 
ties predicted by the logistic regression model for the water meter box dataset. Dark shaded 
areas show parts of the greater Tucson metropolitan area where water meter boxes are pre- 
dicted to have high occupancy rates, whereas light shaded areas are predicted to have low 
occupancy rates. (Reprinted from Landscape Urban Plann., 100, Baum, K.A., Kolodziej, 
E.Y., Tchakerian, M.D., Birt, A.G., Sherman, M., and Coulson, R.N., Spatial distribution of 
Africanized honey bees in an urban landscape, 153—162, Copyright [2011], with permission 
from Elsevier.) 
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FIGURE 6.6 Spatial distribution of Africanized honey bee colony multiple occupancy 
probabilities predicted by the Poisson model for the water meter box dataset. Dark shaded 
areas show parts of the greater Tucson metropolitan area where water meter boxes are pre- 
dicted to have high multiple occupancy rates, whereas light shaded areas are predicted to 
have low multiple occupancy rates. (Reprinted from Landscape Urban Plann., 100, Baum, 
K.A., Kolodziej, E.Y., Tchakerian, M.D., Birt, A.G., Sherman, M., and Coulson, R.N., Spatial 
distribution of Africanized honey bees in an urban landscape, 153-162, Copyright [2011], 
with permission from Elsevier.) 
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FIGURE 9.7 Principles of the larval test developed by Aupinel and coworkers. (From 
Aupinel, P. et al., Bull. Insectol., 58, 107, 2005; Aupinel, P. et al. Pest Manag. Sci. 63, 1090, 
2007; Aupinel, P. et al., Julius-Kühn-Archiv., 423, 96, 2009.) 
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FIGURE 11.1 (a) Adult worker and nest of Vespa velutina nigrithorax. (b) Heat-balling 
behavior of Apis cerana on Vespa velutina auraria (Nepal). 
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FIGURE 11.3  Predicted potential invasion risk of V. v. nigrithorax in Europe, based on 
ensemble forecast models using eight climatic data from WorldClim. The suitability probability 
is increasing from dark blue to red. (From Villemant, C. et al., Biol. Conserv., 144, 2142, 2011.) 


FIGURE 11.4 Predicted potential invasion risk of V. v. nigrithorax in the world, based on 
ensemble forecast models using eight climatic data from WorldClim. The suitability probability 
is increasing from dark blue to red. (From Villemant, C. et al., Biol. Conserv., 144, 2142, 2011.) 
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ABSTRACT 


Quantitative structure—activity relationship (QSAR) models are increasingly used in 
toxicology, ecotoxicology, and pharmacology for predicting the activity of organic 
molecules from their physicochemical properties and/or their structural character- 
istics. The available congeneric and noncongeneric QSAR models used to estimate 
the acute toxicity of pesticides to honey bees were critically analyzed. From the 
available data, new models were also computed from linear and nonlinear methods 
for comparison purposes. Generally, these models provided better prediction results 
than those published in the literature. The advantages and limitations of these mod- 
eling tools are discussed. 
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71 INTRODUCTION 


The history of modern agriculture starts after 1945. Many countries sought to reach 
self-sufficiency in their food production to avoid the supply problems experienced 
during the Second World War. Farms became larger, their activities more mecha- 
nized, and the tendency for specialization in one or more crops became more prom- 
inent [1,2]. This system of intensive agriculture has less use for crop rotation than 
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the earlier systems, although it is well known that crop rotation is quite effective 
in controlling numerous pests. Indeed, the downside of this intensive agriculture 
was the increasing use of fertilizers to enhance productivity and that of pesticides 
to control pests. The extensive use of pesticides has induced resistances in tar- 
get organisms, contamination of aquatic and terrestrial ecosystems, and adverse 
effects on nontarget species. Among this category of organisms, the honey bee 
occupies a key place due to her economic and ecological importance. Pesticides 
act in two ways to reduce bee populations. First, many pesticides necessary in crop 
production are highly toxic to honey bees. In this category, we principally find 
insecticides. Second, the use of herbicides reduces the acreages of attractive plants 
for the bees to forage on. Pesticide damage to bee colonies takes many forms. Bees 
can be poisoned directly when they feed on nectar or pollen contaminated with 
certain pesticides. They can also be poisoned when they fly through a cloud of 
insecticide dust or spray or walk on the treated parts of a plant. The other members 
of the colony can also be contaminated directly or indirectly by pesticides. Thus, 
if the pesticide is brought back to the hive by foragers, the inhabitants constituting 
the colony will be contaminated [2]. 

Obviously, different laboratory tests have been developed for assessing the 
adverse effects of pesticides on honey bees [3]. However, they are expensive, time 
consuming, and require trained personnel. Surprisingly, while in aquatic toxicol- 
ogy the quantitative structure—activity relationship (QSAR) methodology is widely 
used to overcome these problems [4,5], the number of QSAR models derived on the 
honey bee (Apis mellifera) is very scarce. In this context, after having recalled the 
main principles of QSAR modeling, the different models available on bees will be 
reviewed. Strengths and weaknesses of these models will also be discussed, espe- 
cially in the frame of hazard assessment of xenobiotics to honey bees. 


7.2 WHAT IS A QSAR MODEL? 


QSAR modeling is rooted on the fact that the biological activity of molecules directly 
depends on their intrinsic structure. For example, it is well known that the toxicity of 
chlorophenols against aquatic organisms depends only on the number and position 
of the chlorine atoms on the phenol nucleus [6—9]. The mathematical formulation of 
such a type of relationship leads to the design of a QSAR model. Thus, for deriving 
a QSAR model, three different types of elements are required (Figure 7.1). First, 
measured activities for a set of molecules have to be available for the endpoint of 
interest. Second, chemicals must be described by means of their physicochemical 
properties, topological indices, and/or structural features. Last, a statistical method 
must be used for linking the first two elements [10,11]. Specific constraints exist for 
each ingredient and their strict respect allows to obtain models that will be usable 
to make predictions with a satisfying level of confidence [5,12]. Indeed, the raison 
d’étre of a QSAR model is to predict the activity of untested chemicals. This can be 
done in lieu of a laboratory test or to rationalize its design by optimizing the range 
of concentrations or doses to test from the modeling results. Due to the flexibility 
offered by such prediction tools, QSAR models are also used to better understand 
the mechanism of action of chemicals. Indeed, it is easier to test the influence of the 
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FIGURE 7.1 Principle of QSAR model design and functioning. 


addition or deletion of an atom or a functional group on the studied activity. QSAR 
modeling also finds applications in the design of safer chemicals. There are differ- 
ent ways of categorizing the different types of QSAR models irrespective of the 
considered endpoint. One of the most convenient ways consists in considering the 
congeneric versus the noncongeneric models. In the former category, the model is 
computed from a set of molecules presenting the same mechanism of action and/or 
rather similar structures. In the second category, the learning set includes struc- 
turally diverse chemicals encompassing different mechanisms of action. Crudely 
speaking, congeneric QSAR models are focused on mechanistic interpretations, 
while noncongeneric QSAR models are primarily screening tools, having generally 
a large domain of application [12-14]. This classification will be used to discuss the 
different QSAR models available for the honey bee. 


7.3 CONGENERIC QSAR MODELS ON BEES 


The very first QSAR model derived for Apis mellifera was presented in 1990 by Davide 
Calamari during the Fourth International Workshop on QSAR in Environmental 
Toxicology [15] at Veldhoven, the Netherlands. In this pioneering work, in a first 
step, bees were tested for their oral toxicity for 14 organophosphorus insecticides 
that are inhibitors of acetylcholinesterase (AChE). The mortality was recorded after 
24 h of exposure to calculate LD., values (i.e., doses of chemicals at which 50% of 
the test organisms die) expressed in umol/bee. 

The best QSAR model included six parameters as shown in the following equation: 


log1/LDso = 114logP — 0.28logP? + 0.28% — 0.76%% — 10973 
4 0.096 y5 + 12.29 (7.1) 


n-14 r-0908 s= 0.28 
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where 
n is the number of chemicals of the training set; 
r° is the coefficient of determination; and 
s is the standard error of estimate. 


The molecular descriptors involved in Equation 7.1 encode different physicochemi- 
cal and structural information. The 1-octanol/water partition coefficient (log P) char- 
acterizes the hydrophobicity of the molecules [16,17]. The molecular connectivity 
indices, 'y and ?y",,, provide topological information on the molecules. 'y is a simple 
molecular connectivity index of order 1, while ?y",, is a valence connectivity index of 
order 2 [18]. Moreover, ?y*,, was calculated on the oxygen metabolite. This explains 
the subscript in the topological index [15]. y, is an electronic descriptor calculated 
by Vighi et al. [15]. 

Equation 7.1 does not satisfy the current principles of good modeling practices 
in QSAR [12,19]. Indeed, the model is overparameterized, and it was not tested on 
an external test set (i.e., not used to compute the model). However, more than 20 
years ago, we were at the beginning of the environmental QSAR and it was rather 
commonplace to do so. Note that it was also usual to work on his/her own experi- 
mental data to derive QSARs. Anyway, this study was definitively a visionary work, 
paving the way for models that aim to predict the toxicity of pesticides to honey 
bees. It is noteworthy that Vighi et al. [15] derived an additional QSAR regression 
model with the same set of descriptors by including the herbicide glyphosate in 
the previous set of 14 organophosphorus insecticides. The statistical results were 
broadly the same. 

Because carbamates present the same mechanism of action as the organophos- 
phorus insecticides, Dulin et al. [20] derived different QSAR models from 45 toxic- 
ity data for bees retrieved from various sources. The data consisted of 30 contact 
LD,, values for organophosphorus insecticides and 15 contact LD,, values for car- 
bamates, all being measured after 48 h of exposure and expressed in pmol/bee. This 
database was randomly split into a training set of 39 insecticides for computing the 
QSAR models and an external test set of 6 insecticides for estimating the predic- 
tive power of the models. All the chemicals were described by means of more than 
2,500 topological and physicochemical descriptors [21,22]. The QSARs were built 
from genetic function approximation (GFA) [23]. Briefly, GFA generates a popu- 
lation of QSAR models that are scored according to their performances. In this 
work, the performance of each model was estimated from the calculation of r? and 
root mean square error (RMSE) and by using leave-one-out and Y-randomization 
procedures. The GFA simulation conditions were 1,000 generations and 500 
populations. The total number of model equations in the evolving population was 
500. The functional form of the model was linear and the maximum number of 
terms in each model was fixed to five [20]. The 10 best QSAR models were kept and 
averaged to constitute a consensus model (r? 20.805, RMSE 20.350). The consensus 
model obtained good predictions on the external test set of three carbamates and 
three organophosphorus insecticides with r? and RMSE values of 0.850 and 0.218, 
respectively (Tables 7.1 and 7.2). Three descriptors were frequently found in the 
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TABLE 7.1 


Observed [20] and Calculated Contact Toxicity 


Values (log 1/LD;,, umol/Bee) Obtained with the 
Consensus (C10), Multiple Regression (MRA), 
Three-Layer Perceptron (TLP), and Support Vector 
Machine (SVM) Models 


Nb. 


= = 
= O X AAI ON. Q + OQ N — 


Insecticide 


Acephate 
Alanycarb* 
Aldicarb 
Aminocarb 
Azinphos-methyl 
Bendiocarb 
Benfuracarb? 
Bufencarb 
Carbaryl 
Carbofuran 
Chlorpyrifos 
Diazinon 
Dichlorvos 
Dimethoate 
EPN 

Ethion 
Ethoprofos 
Famphur 
Fenamiphos 
Fenitrothion 
Fensulfothion 
Fenthion 
Fonofos 
Formetanate 
Fosthiazate* 
Malathion 
Methamidophos 
Methidathion 
Methiocarb 
Methomyl 
Naled 
Oxamyl 
Parathion 
Phenthoate 
Phosalone 
Phosmet 
Phosphamidon 


Obs. 


2.19 
2.77 
2.83 
3.24 
2.88 
2.72 
3.41 
3.14 
3.16 
3.79 
3.78 
2.92 
2.65 
3.29 
3.13 
1.27 
1.64 
2.90 
3.04 
4.19 
2.97 
2.96 
1.88 
1.20 
3.04 
3.22 
2.02 
3.37 
2.99 
3.01 
2.90 
2.67 
3.23 
3.02 
1.93 
3.16 
2,31 


C10 


2.03 
3.00 
3.14 
2.90 
2.77 
2.86 
3.57 
3.09 
2.95 
3.11 
3.01 
2.81 
2.38 
3.35 
3.24 
1.35 
1.39 
2.88 
2.87 
3.91 
2.80 
3.39 
2.42 
1.87 
3.19 
2.85 
2.08 
3.22 
3.37 
3.24 
2.75 
2.2]^ 
3.41° 
3.48° 
2.30° 
2.65^ 
227° 


MRA 


1.90 
2.75 
3.28 
3.19 
2.49 
2.91 
3.40 
3.18 
3.15 
3.11 
2.78 
2.80 
2.43 
3.21 
3.05 
1.31 
1.36 
2.87 
2.92 
3.82 
2.74 
3.44 
2.38 
1.94 
3.21 
2.47 
2.65 
3.19 
3.67 
3.47 
2.66 
2.26 
3.29 
3.31 
1.94 
2.25 
2.20 


TLP 


2.14 
2.88 
3.11 
3.18 
2.52 
3.00 
3.16 
3.07 
3.13 
3.09 
3.05 
3.07 
2.90 
3.15 
3.07 
1.11 
0.81 
3.25 
2.96 
3.59 
3.24 
3.13 
2.49 
1.77 
3.45 
2.85 
1.99 
3.11 
3.19 
3.45 
2.95 
2.45 
3.37 
3.13 
2.00 
2.42 
2.27 


SVM 


2.02 
2.87 
2.90 
3.41 
2.70 
3.15 
3.08 
2.93 
3.02 
3.60 
3.07 
3.10 
2.47 
3.47 
3.31 
1.27 
1.82 
3.07 
3.13 
4.02 
2.80 
3.15 
2.53 
1.38 
2.87 
3.04 
2.20 
3.19 
2.80 
3.19 
3.08 
2.48 
3.40 
3.21 
2.11 
2.98 
2.38 
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TABLE 7.1 (continued) 


Observed [20] and Calculated Contact Toxicity 


Values (log 1/LD;,, umol/Bee) Obtained with the 
Consensus (C10), Multiple Regression (MRA), 
Three-Layer Perceptron (TLP), and Support Vector 
Machine (SVM) Models 


Nb. 


38 
39 
40 
41 
42 
43 
44 
45 


Insecticide Obs. 
Profenofos 3.60 
Propoxur 2.19 
Pyrimicarb 1.11 
Quinalphos? 3.24 
Temephos* 2.48 
Tetrachlorvinphos 2.43 
Thiodicarb? 2.06 
Trichlorfon 0.64 


a Test set chemicals. 


C10 
3.36 
2.58 
1.30 
3.18 
1.90 
3.01 
2.01 
0.93 


MRA 


3.07 
2.65 
1.67 
3.02 
1.95 
3.02 
1.99 
1.50 


TLP 


3.37 
2.81 
1.43 
3.04 
2.31 
3.00 
2.06 
0.88 


SVM 
3.42 
2.87 
1.28 
3.30 
2.53 
2.79 
1.92 
0.81 


b Activity reconstituted from the information found in the supplemen- 


tary material of Dulin et al. [20] and inspection of the original papers 


and database cited therein. 


TABLE 7.2 


Distribution of Residuals (Absolute 


Values), Differences between the 


Experimental and the Calculated 


Contact Toxicity Values (log 1/LD5o, 


pmol/Bee) Obtained with the Consensus 


(C10), Multiple Regression (MRA), 
Three-Layer Perceptron (TLP), and 


Support Vector Machine (SVM) Models 


Range C10 
«0.25 20(5*) 
0.25-0.50° 13 
0.50-0.75° 5(1) 
0.75-1.00° 1 
>1.00 0 


MRA 
17(5) 
10 
8(1) 
3 
1 


TLP 
20(4) 
10(2) 
7. 
2 
0 


SVM 
34(5) 
2(1) 
3 
0 
0 


a [ncluding number of residuals from the external test 


set. 
^ Excluded value. 
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individual models. Dipole X DMol3 that encodes the polarity of the molecules 
is found in the 10 individual models with always a positive sign. GATS6e is also 
included in all the individual models with a positive contribution. This parameter 
belongs to the category of the autocorrelation descriptors [24] that are topological 
indices encoding physicochemical information [25]. Here, the property of concern 
is the Sanderson electronegativity, and the calculation is made by considering a dis- 
tance of 6. CIC2 is the complementary information content of the molecular graph 
calculated from the second-order neighborhood of the vertices. It is particularly 
suited to account for branching and complexity information in a chemical structure 
[26]. CIC2 contributed negatively in eight equations. In the two other models, it was 
replaced by SIC2, the structural information content for the second-order neigh- 
borhood of vertices in the hydrogen-filled graph [26]. This topological parameter, 
which positively contributes in the two equations, also encodes branching and com- 
plexity information. 

The importance of Dipole X DMol3, GATS6e, and CIC2 to explain the toxic- 
ity of carbamate and organophosphorus insecticides to honey bees was confirmed 
through the use of a honey bee AChE homology model [27] (ID: Q4LEZ2_APIME), 
which was designed from the 2.7 A resolution crystal structure (PDB: 1DX4) of 
Drosophila melanogaster AChE (DmAChE) complex with tacrine derivative as a 
template (sequence identity — 6190). 

Despite satisfying statistics, it is noteworthy that the consensus model proposed 
by Dulin et al. [20] is rather complex, averaging 10 equations and a total of 16 molec- 
ular descriptors. Consequently, using the same training and test sets, an attempt 
was made to see whether it was possible to obtain simpler QSAR models show- 
ing acceptable statistics, only from the three main molecular descriptors, namely, 
Dipole X DMol3, GATS6e, and CIC2. A multiple regression analysis performed 
from these three descriptors led to r? values of 0.65 and 0.87 for the training set 
and external test set, respectively. The prediction performances for the test set are 
comparable to those obtained with the consensus model of Dulin et al. [20] (Table 
7.2). Conversely, those obtained for the learning set are lower, with some larger 
residuals (difference between the observed and calculated log 1/LD;, values) than 
with the consensus model [20]. Thus, with the consensus model, one insecticide 
presents a residual 20.75 (in absolute value) versus four with the multiple regression 
model, one being >1 (absolute value). Because the artificial neural networks (ANNs) 
[28] have demonstrated their interest in environmental toxicology [29,30], a three- 
layer perceptron (TLP) [31] was experienced on the reduced set of three descriptors. 
The TLP is perhaps the most popular supervised ANN in use in QSAR (see, e.g., 
[32-39]). Because its functioning has been widely described in the literature (see, 
e.g., [40]), only the basic principles are recalled here. A TLP includes one input 
layer with a number of neurons corresponding to the number of selected molecular 
descriptors, one output layer of one neuron corresponding to the modeled activity, 
and one hidden layer, between the two aforementioned layers, with an adjustable 
number of neurons for distributing the information (Figure 7.2). Too many hidden 
neurons often lead to overfitting, and hence, to avoid problems, their number has to 
be limited. This is done by a trial-and-error procedure and also by the use of prun- 
ing algorithms. The neurons of each layer are connected in the forward direction 
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FIGURE 7.2 Architecture of a three-layer perceptron, which includes an input layer (IL), 
a hidden layer (HL), and an output layer (OL). 


(i.e., input to output) and are activated by means of activation functions. Each con- 
nection is associated with a weight. The weights are adjusted during the learning 
process, which aims to minimize an error computed from the target and calculated 
outputs. Numerous learning algorithms are available, among which the backpropa- 
gation, the Levenberg-Marquardt, and Broyden-Fletcher-Goldfarb-Shanno algo- 
rithms were tested alone or in combination [40]. The calculations were performed 
with the data mining module of the Statistica! M software (StatSoft, Fr). 

In this study, the maximum number of hidden neurons was fixed to three to have a 
TLP with the smallest possible configuration. Among all the different architectures, 
learning algorithms, and parameter values tested, the best results were obtained with 
a 3/3/1 TLP with a bias connected to the hidden and output layers and using the 
BFGS (Broyden-Fletcher-Goldfarb-Shanno) second-order training algorithm. The 
hidden and output activation functions were a hyperbolic tangent activation function 
(tanh) and a logistic activation function, respectively. The convergence was obtained 
after only 47 cycles. With such a configuration, the r? values for the training and test 
sets were equal to 0.77 and 0.79, respectively. The calculated log 1/LD; values with 
this TLP model are listed in Table 7.1 and the distribution of the residuals is given 
in Table 7.2. Despite the presence of outliers, inspection of Tables 7.1 and 7.2 shows 
that the predictive performances of the TLP are not so bad, especially for the test 
set chemicals that always have residuals «0.5 (in absolute value), while it is not the 
case for temephos (#42), which presents a residual value of 0.58 with the consensus 
model [20] (Table 7.1). Note that for this test set insecticide, a residual value of 0.17 
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was obtained with the TLP (Table 7.1). It is noteworthy that the addition of a fourth 
descriptor as input neuron (e.g., LUMO Energy DMol3) allowed to significantly 
outperform the prediction performances of the consensus model [20] on both the 
training and test sets. 

Support vector machines (SVMs) [41,42] have also gained prominence in SAR 
and QSAR due to their effective performances in comparison with the classical 
linear methods commonly used in structure—activity modeling (see, e.g., [43—47 ]). 
SVMs [41,42] are rooted on two key ideas. The first one is the notion of maximum 
margin. The margin is the distance between the boundary of separation and the clos- 
est samples. These are called support vectors. The separation boundary is chosen as 
the one that maximizes the margin. In order to deal with cases where the data are not 
linearly separable, the second key idea of SVMs is to transform the representation 
space of the input data into a space of greater dimension (possibly infinite), in which 
it is likely that there exists a linear separation. This is achieved through a kernel 
function. The following kernel functions are commonly tested: linear, polynomial, 
radial basis function (RBF), and sigmoid. To construct an optimal hyperplane, SVM 
uses an iterative training algorithm that minimizes an error function. According to 
the form of the error function, the SVM will be a classifier or a regression tool. Two 
types of support vector regressions (SVRs) can be computed, the so-called SVR type 
1 (e-SVR) and type 2 (v-SVR) with their own error functions. Both were tested in the 
present study. The advantages of an SVM are the presence of a global minimum solu- 
tion resulting from the minimization of a convex programming problem, relatively 
fast training speed, and sparseness in solution representation. The calculations were 
performed with the data mining module of the Statistica software (StatSoft, Fr). 

In our study, SVR type 1, with a RBF as kernel, provided the best prediction 
results with the adjustable parameters C, e, and y set to 20, 0.1, and 0.60, respectively. 
In that case, the r? values for the training and test sets were both equal to 0.89. The 
SVR model using only the three main descriptors outperforms the consensus model 
of Dulin et al. [20] as well as the TLP model (Tables 7.1 and 7.2). 

Our trials confirm that the Dipole X DMol3, GATS6e, and CIC2 descriptors 
allow encoding of the main structural characteristics of the studied carbamate and 
organophosphorus insecticides because rather satisfying prediction results can be 
obtained only from them. The sine qua non to obtain such results is to use a nonlinear 
method in place of a classical linear approach. Even if the interpretation of a TLP 
or an SVM is less straightforward than a simple multiple regression analysis, their 
use will simplify the modeling of these toxicity data by using a limited number of 
descriptors. 


7.4 NONCONGENERIC QSAR MODELS ON BEES 


One hundred pesticide toxicity values on honey bees (LC, or LD;, in umol/bee) 
obtained under well-defined and controlled laboratory conditions (Table 7.3) were 
used by Devillers et al. [34,35] for deriving a QSAR model based on a TLP. The dif- 
ferent families of pesticides were described by means of autocorrelation descriptors 
[24,25]. From the fragmental constants of Rekker and Mannhold [48], an autocor- 
relation vector H representing lipophilicity was derived. Second, an autocorrelation 
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TABLE 7.3 

Observed (Obs.) [34,35], Calculated (Cal.), and 
Residual (Res.) Acute Toxicity Values (log 1/LD,o, 
umol/Bee) Obtained with the TLP Model 


Nb.? Pesticide Obs. Cal. Res. 
1 TEPP 5.16 5.16 0.00 
2 Bioethanomethrin 4.02 3.45 0.57 
3 Resmethrin 3.74 3.29 0.45 
4 Pay-off (flucythrinate) 3.76 3.70 0.06 
5 Deltamethrin 3.88 3.69 0.19 
6 Chlorpyrifos 3.50 2.68 0.82 
7 Parathion-methyl 3.38 3.55 -0.17 
8 Dieldrin 3.46 3.12 0.34 
9 Carbofuran 3.17 2.80 0.37 

10 Permethrin 339 342 —0.03 

11 Parathion 322 2.87 0.35 

12 Fenitrothion 3.20 2.96 0.24 

13 Dimethoate 3.08 2.86 0.22 

14 Methidathion 3.11 2.70 0.41 

15 EPN 3.13 2.03 1.10 

16 Etrimfos 3.04 3.07 —0.03 

17 Aldicarb 2.84 3.15 —0.31 

18 Mexacarbate 2.87 2.51 0.36 

19 Dicrotophos 2.80 3.15 —-0.26 

20 Mevinphos 2.87 2.80 0.07 

21 Fenthion 2.94 2.50 0.44 

22 Fensulfothion 2.900 2.98 -0.02 

23 Aldrin 3.02 3.03 -0.01 

24 Monocrotophos 2.80 2.78 0.02 

25 Diazinon 2.91 2.70 0.21 

26 Methiocarb 2.78 2.61 0.17 

27 Fenvalerate 3.01 3.75 —0.74 

28 Famphur 2.90 3.16 —-0.26 

29 Azinphos-methyl 287 2.47 0.40 

30 Bendiocarb 2.72 2.58 0.14 

31 Naled 2.89 2.84 0.05 

32 Dichlorvos 2.64 2.69 —0.05 

33 Heptachlor 2.85 2.25 0.60 

34 Isofenphos 276 2.71 0.05 

35 Carbosulfan 275 3.43 —0.68 

36 Malathion 2.66 2.74 —0.08 

37 Azinphos-ethyl 2.56 2.61 —0.05 

38 Aminocarb 2.207 2.48 -0.21 

39 Phosmet 245 2.27 0.18 


40 Acephate 2.18 2.76 —0.58 
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TABLE 7.3 (continued) 

Observed (Obs.) [34,35], Calculated (Cal.), and 
Residual (Res.) Acute Toxicity Values (log 1/LD,o, 
umol/Bee) Obtained with the TLP Model 


Nb.* Pesticide Obs. Cal. Res. 
41 Methomyl 2.10 2.06 0.04 
42 Propoxur 2.19 2.08 0.11 
43 Methamidophos 201 2.02 -0.01 
44 Stirofos (tetrachlorvinphos) 2.42 3.22 —0.80 
45 Fenamiphos 2.33 1.89 0.44 
46 Phosphamidon 2.32. 2:27 0.05 
47 Carbaryl 2.12 1.89 0.23 
48 Pyrazophos 2.30 2.06 0.24 
49 Temephos 2.52 2.29 0.23 
50 Trichloronate 222 1.86 0.36 
51 Crotoxyphos 2.43 2.16 —0.03 
52 Oxydemeton-methyl 1.94 1.87 0.07 
53 Profenofos 203 1.12 0.91 
54 Terbufos 1.85 1.53 0.32 
59 Ethoprophos 1.64 1.56 0.08 
56 Ronnel 1.76 2.42 —0.66 
57 Disulfoton 1.65 1.73 —0.08 
58 DDT 1.76 2.35 -0.59 
59 Ethiofencarb 1.52 1.54 —0.02 
60 Thiodicarb 170 2.12 —0.42 
61 Sulprofos 1.65 2.05 —0.40 
62 Fonofos 145 0.72 0.73 
63 Chlordane 167 2.15 —0.48 
64 Phosalone 1.61 2.23 —0.62 
65 Phorate 1.40 1.82 —0.42 
66 Oxamyl 133 1.77 —0.44 
67 Carbophenothion 142 2.13 -0.71 
68 AC 303,630 331 2.87 0.44 
69 Alanycarb 2.70 2.37 0.33 
70 Chlorpyrifos-methyl 2.93. 2:97 —0.04 
71 Bensultap 122 113 0.09 
72 Azamethiphos 3.5] 3.86 —0.35 
73 EPTC 124 123 0.01 
74 Napropamide 0.35 0.49 -0.14 
75 Dicloran 0.06 0.40 —0.34 
76 Diethofencarb 1413 1.01 0.12 
TI Dithiopyr 0.70 047 0.23 
78 Orbencarb 0.40 0.79 —0.39 
79 Fenazaquin 1.57 2.50 —0.93 
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TABLE 7.3 (continued) 

Observed (Obs.) [34,35], Calculated (Cal.), and 
Residual (Res.) Acute Toxicity Values (log 1/LD,o, 
umol/Bee) Obtained with the TLP Model 


Nb.? Pesticide Obs. Cal. Res. 
80 Quinalphos 3.60 3.62 0.01 
81 Pyridaben 2.82 2.80 0.02 
82 Mephosfolan 1.89 1.94 —0.05 
83 Imazalil 0.87 1.59 —0.72 
84 Metconazole 0.52 1.50 —0.98 
85 Pyridaphenthion 363 325 0.38 
86 Pyrifenox 0.70 0.90 —0.20 
87 Quizalofop 0.84 1.09 —0.25 
88 Tebutam 0.37 0.40 —0.03 
89 Thiometon 2.64 2.15 0.49 
90 Cypermethrin 4.08 3.66 0.42 
91 Diafenthiuron 226 2.79 —0.53 
92 Tralomethrin 3.74 3.74 0.00 
93 Propargite 137 1.82 —0.45 
94 Diclomezine 1.41 1.35 0.06 
95 Phenthoate 343 2.91 0.52 
96 Piperophos 1.07 1.25 -0.18 
97 Silafluofen 291 2.76 0.15 
98 Propachlor -0.17 0.39 —-0.56 
99 Tralkoxydim 0.79 0.65 0.14 

100 Propisachlor 0.45 = 1.01 —0.56 


a Pesticides #1—89 were used as training set and 490—100 as exter- 
nal test set. 


vector MR, encoding molar refractivity, was designed from the fragmental constants 
of Hansch and Leo [49] or directly from the Lorentz-Lorenz equation. Last, auto- 
correlation vectors encoding the H-bonding acceptor ability (HBA) and H-bonding 
donor ability (HBD) of the molecules were also calculated by means of Boolean 
contributions (i.e., 0/1). The autocorrelation vectors were calculated by means of 
AUTOCOR™ 2.4 (CTIS, France) using SMILES (Simplified Molecular Input Line 
Entry System) notation as inputs. For the autocorrelation vectors H, MR, and HBA, 
a truncation of the vectors was performed in order to obtain five autocorrelation 
components (distances 0—4 in the graphs of the molecules). For the HBD autocorre- 
lation vector, only the first component was selected. The database was randomly split 
into a training set of 89 chemicals and an external test set of 11 chemicals. However, 
an attempt was made to have toxicity data of the same origin in the learning set. 
The calculations were performed with the ANN module of the Statistica soft- 
ware, version 6 (StatSoft, Fr). The backpropagation algorithm was used to train 
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the ANN. Different series of runs were performed in order to determine the num- 
ber of descriptors to use as input neurons to obtain good prediction results, espe- 
cially on the external test set. The H, MR, and HBA autocorrelation vectors of five 
components were first introduced separately in the ANN. They were not able to give 
acceptable prediction results on both sets. Addition of HDB, did not increase the 
quality of modeling results. Conversely, the use of the 15 descriptors (i.e., Hj-H,, 
MR,-MR,, HBA,)—HBA,) as inputs in the TLP allowed to obtain good prediction 
results on both sets with a hidden layer of three neurons in about 2,000 cycles. 
The feature selection process of the Statistica software, mainly based on genetic 
algorithm [50], was used to reduce the number of descriptors. The best simulation 
results were obtained with H,-H,, MR;-MR,, and HBA;-HBA, as input neurons. A 
12/3/11 ANN with a learning rate r| 20.5 and a momentum «=0.9 led to acceptable 
predictions in 2,492 cycles. Indeed, the r? and RMS (root mean square residual) 
values for the training set were equal to 0.82 and 0.43, respectively. The r? and 
RMS values for the external test set were equal to 0.94 and 0.39. The inspection 
of Table 7.3 shows the presence of significant outliers that are EPN (#15), profe- 
nofos (#53), fenazaquin (#79), and metconazole (#84) with residual values of 1.10, 
0.91, —0.93, and —0.98, respectively. 

It is noteworthy that runs were also performed by changing the composition of 
the training and test sets but an 89/11 ratio was always maintained. No significant 
changes were noted in the prediction performances. Attempts were also made to 
derive a model from a partial least squares (PLS) regression [51,52] analysis. 
Unfortunately, this did not yield satisfying results. Indeed, in all cases, very large 
outliers were obtained for numerous pesticides. 

Amaury et al. [53] used a database of 105 structurally diverse pesticides to 
derive semiquantitative (three classes of activities) and quantitative (log 1/LDso, 
umol/bee) structure-activity models, experiencing various types of molecular 
descriptors and different linear and nonlinear statistical methods. Seventeen mol- 
ecules were selected to constitute the external test set. The remaining pesticides 
were used to derive the models. The most interesting modeling approach was the 
hybrid QSAR model combining an ANN and a PLS model. The full characteristics 
of the ANN, including seven descriptors, were not given but it showed r? values of 
0.71 and 0.80 for the training set and external test set, respectively. Twelve descrip- 
tors were used to derive the PLS model that presented r? values of 0.66 and 0.69 
for the training set and external test set, respectively. The hybridization of the two 
models allowed to obtain an r? value of 0.74 for the training set and an r? value of 
0.84 for the external test set. The 19 descriptors used in the two individual models 
and found in the hybrid model were topological indices and structural fragments. 
The former type of descriptors encodes shape and branching information while the 
latter type accounts for the reactivity of specific atoms or functional groups. This 
is in agreement with our results [34,35] because the autocorrelation components of 
zero and first orders encode the shape of the molecules while those of higher orders 
account for branching information. In addition, the autocorrelation vectors being 
computed from atomic contributions of specific properties, their components of 
different orders also account for the reactivity of specific structural features in the 
molecules [24,25]. 
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The hybrid model was further refined by the deletion of outliers in the train- 
ing and test sets. The new hybrid model derived from 80 pesticides described by 
16 molecular descriptors showed an r° value equal to 0.77. An r? value equal to 0.83 
was obtained on the new external test set of 15 pesticides [53]. 

Last, a noncongeneric model was derived by Toropov and Benfenati [54] from 
molecular descriptors directly obtained from the SMILES strings of 105 molecules 
tested on bees. Twenty molecules were randomly selected as a test set. The r? values 
obtained for the training and test sets were equal to 0.68 and 0.72, respectively. 

While the models of Devillers et al. [34,35], Amaury et al. [53], and Toropov and 
Benfenati [54] present rather similar domains of application, the inspection of the 
r° values obtained on their training and test sets shows that the prediction perfor- 
mances of the former significantly outperform those of the two other models. 


7.5 ADVANTAGES AND LIMITATIONS OF QSAR MODELS FOR 
PREDICTING THE TOXICITY OF CHEMICALS TO BEES 


The raison d'étre of the QSAR models is the prediction of the activity of organic 
molecules from their physicochemical properties and/or their structural character- 
istics coded by means of topological indices or by important constitutive structural 
fragments that can be atoms or functional groups. Thus, the models presented in 
this study may be used to predict the acute toxicity of pesticides to the honey bee. 
Depending on their domain of application, they can be used to fill data gaps rapidly 
and at reduced cost, to select the optimal range of concentrations prior to conducting 
a laboratory test, to detect chemicals that present specific behaviors, or to help in 
the understanding of their mechanism of action. It is worth noting that the homol- 
ogy models are particularly suited to consolidate mechanistic information provided 
by QSAR results [20]. They can also directly intervene in the search for structure— 
activity relationships [55]. 

However, the QSAR results cannot be directly used to fully assess the hazard of 
xenobiotics to honey bees. Indeed, they are derived from standardized laboratory 
test results performed on technical grade material of high purity while formulations 
with different characteristics are used in practice. These formulations behave differ- 
ently on Apis mellifera than active molecules [56]. This is also true for non-Apis bees 
such as leafcutting bees (Megachile rotundata), alkali bees (Nomia melanderi), and 
bumblebees (Bombus spp.) [56]. Attempts have been made to derive QSAR models 
showing better practical realism [32,33,37,57] but no such models have yet been 
derived on bees. 

Existing QSAR models on bees allow the prediction of acute toxicity effects 
while it is well known that sublethal effects can adversely impact a bee colony (see, 
e.g., [58-62]). The lack of QSAR models on sublethal endpoints relies on the scar- 
city of biological data. Indeed, it is necessary to have sufficient results for different 
molecules to obtain a statistically significant QSAR. In the same way, because the 
existing QSAR models on bees were derived from pesticide data, they can only be 
used to predict the toxicity of this type of molecules. In other words, they cannot 
be employed to predict the acute toxicity of other man-made chemicals that can 
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potentially contaminate honey bees and their hives such as solvents, polycyclic 
aromatic hydrocarbons, dioxins, and polychlorinated biphenyls [63,64]. Last, it is 
obvious that the available QSAR models on bees cannot be used to predict the toxic- 
ity of a mixture of chemicals. 

The aforementioned weaknesses are logical because whatever the type of model, 
it is important to keep in mind that it can only be used for the goal for which it was 


built. 
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ABSTRACT 


Honey bees are very sensitive organisms, and their vulnerability toward chemical 
pollution is a priority environmental issue. In this chapter, the importance and the 
fundamental of a mathematical model able to predict the fate of chemicals in the 
hive are described. The “hive model" presented here is able to consider different 
contamination pathways: from inside the hive via pesticide treatments against bee 
pests or from outside by means of the eventual contamination present in nectar, 
pollen, resin, water, air, or vegetation. The input parameters of the model are the 
physical-chemical properties of the compound and the major characteristics of the 
hive ecosystem, from which it calculates contamination residues in bee products 
(honey, pollen, royal jelly, wax, and propolis) over time. The model can be applied 
to all nonionic chemicals with a measurable vapor pressure (volatile or semivolatile 
compounds). The model was validated with contamination data in bees, wax, and 
honey following tau-fluvalinate application in two experimental hives. The compari- 
son between measured and modeled data over a period of 6 months was very good. 
Even if more experimental data should be provided for a better calibration of the 
model, it seems to correctly quantify the main contamination pathways from outside 
and within the hive. 
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8.1 VULNERABILITY OF BEES TO CHEMICAL 
POLLUTION: BEES AS SENSITIVE SPECIES 


Honey bees are considered a sensitive species indicator of environmental quality. 
The survival of honey bee colonies is related to the good individual performance 
(individual fitness) and to the efficacy of communication and cooperation between 
classes of bees (colony fitness). Moreover, honey bee breeding is certainly respon- 
sible for an artificial reduction of genetic diversity and for a lack of the natural selec- 
tion benefits. These elements accentuate the vulnerability of honey bee colonies and 
their sensitivity to pollution. Since the late 1990s, widespread events of honey bee 
disappearance especially in the United States and in Europe (Spain, France, Italy and 
Germany) happened [1,2]. These events were considered alarming because it was not 
possible to relate them to a specific cause. This new pathology was called colony 
collapse disorder (CCD) [3,4]. Recrudescence of old and new pathologies [5,6], 
environmental stresses, including climate change, [7] and pesticide contamination 
[8,9] were considered as possible causes perhaps also in association among each 
other. The first two adversities are related to the genotypes of honey bee colonies, 
and they directly reflect the vulnerability of bees toward abiotic (climate change) and 
biotic (parasite) stresses, while the third one is directly related to human activity in 
terms of chemical contamination by xenobiotics. 

Neonicotinoid insecticides were indicated as a possible cause of CCD events, 
and this possibility is a meaningful example of how xenobiotics can affect nontarget 
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species in unsuspected ways (failure of risk assessment evaluation). Neonicotinoid 
insecticides act on the insect nicotinic (acetylcholine) receptor (nAChR) [10], 
and therefore they are toxic to bees too. Iwasa et al. [11] revealed that the nitro- 
substituted neonicotinoids were most toxic to honey bees with very low contact 
LD;, values even of 18 ng bee^ as in the case of imidacloprid. Neonicotinoid 
insecticides are used in agriculture, mainly as a seed dressing in many crops 
such as corn and sunflower. Being systemic insecticides, application via seed 
treatment enables crop protection from soil invertebrates and sucking insects both 
during germination and later growth. Therefore, neonicotinoid insecticides affect 
pollinating insects as powder dispersion during the sowing procedures via the drill 
fan (pneumatic seed drills) [12-14] and through the contamination of pollen and 
nectar, produced by crops that have been grown from treated seeds [15]. 

This example demonstrates that chemical exposure may happen multiple ways, 
some of which are easily misunderstood. In fact, neonicotinoid insecticide exposure 
toward bees may happen during sowing operations, when pesticide-contaminated pow- 
ders are dispersed into air, and later when the powders in air subsequently deposit 
on local soil and vegetation. Moreover, because of the systemic activity of these 
insecticides, exposure may happen during the flowering phase of plants grown from 
treated seeds, when contaminated pollen and nectar can be foraged by bees and 
other pollinator insects. 


8.1.1 CHEMICAL CONTAMINATION SOURCES 


Two main contamination sources toward bees can be distinguished: a direct con- 
tamination by the distribution of pesticides inside the hive to protect honey bees 
from parasites and an indirect contamination by all the chemicals that involuntarily 
come from outside. 

The direct contamination is generally known and deals with few chemicals 
at high concentrations, as in the case of acaricides used against the mite Varroa 
destructor. Wallner [16], Bogdanov [17], and Johnson et al. [2] reviewed the prob- 
lem of contamination of bee products following pesticide application within the 
hive. Fat-soluble and stable pesticides, such as bromopropylate, coumaphos, and 
t-fluvalinate, are known to accumulate in wax, year by year, while fat-soluble and 
volatile compounds, such as essential oils, and unstable pesticides, such as amitraz, 
do not persist because they volatilize or degrade. On the other hand, water-soluble 
chemicals, such as formic acid, oxalic acid, and cymiazole, do not accumulate in 
wax, but they are found in honey, producing an unwanted taste. 

The indirect contamination source is more complex because it deals with 
many chemicals generally at low concentrations. Barmaz et al. [18] developed a 
site-specific method for assessing risks to pollinators from pesticides used in the 
surroundings of a bee colony. They concluded that risk levels were very differ- 
ent depending on agronomic practices and crop type. The greatest risk is gener- 
ally found at the beginning of the growing season for annual crops and later in 
June-July for permanent crops. As an example, the case of neonicotinoid insecti- 
cides highlighted how pesticides coming from outside can severely threaten honey 
bee survival. Another example of unsuspected contamination is the presence of 
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FIGURE 8.1 Schematic diagram of the main contamination sources and output ways for 
the hive ecosystem. 


antibiotics in bee products, in the absence of direct applications to the hive. A 
possible explanation is the transfer of antibiotics from sewage of farms where 
these chemicals are extensively used for curing and preventing animal diseases. 
Antibiotic residues can be taken up by bees drinking sewage as water supply (bees 
take up sewage also in the presence of alternative cleaner water supply), and later 
bees can transfer antibiotics to honey bee products inside the hive. These examples 
highlight the complexity and the importance of the indirect contamination sources, 
which may affect hives in unsuspected ways. Figure 8.1 summarizes a scheme of 
the possible contamination sources and contamination output from the hive. Some 
of these pathways are well documented such as the contamination via direct pes- 
ticide application, but others were only recently considered such as those coming 
from pesticide-exposed pollen [19] or from environmental exposure of foraging 
bees [14,18,20]. The complexity of these multiple contamination sources and that 
of the system itself needs a careful description of the bee ecology in the frame of 
modeling applications. 


8.1.2 PREDICTING CHEMICAL CONTAMINATION WITH MATHEMATICAL MODELS 


Mathematical models are useful tools for evaluating the environmental distribution 
and fate of chemicals [21]. Models forecast the fate of chemicals and also the 
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resulting levels of exposure before their use. Moreover, they facilitate a greater 
comprehension of the distribution of chemicals [22]. Models based on fugacity 
[23,24] have been extensively applied to nonionized organic chemicals at various 
scales: global [25], regional [26], field [27], and microecosystem [22,28,29]. These 
models require three types of input data: the physicochemical properties of the 
compounds (molecular weight, water solubility, vapor pressure, and partition coef- 
ficients), the emission patterns (amounts emitted, space and time distribution of 
emissions), and the environmental characteristics of the ecosystem (temperatures, 
compartment volumes and compositions, and fluxes). The quantification of these 
aspects in a model system is able to furnish information about the fate of a specific 
chemical with an error (uncertainty of the prediction) related to the simplification 
and the generalization introduced in the model, to the goodness of the input data 
and to stochastic events not included in the model. A crucial point of models is the 
quantification of the mass fluxes and the exchange parameters between compart- 
ments. The former explains the transfer of a contaminant in different places of 
the same compartment (e.g., the transfer of a pesticide by the air flux from outside 
to inside) and the second indicates the transfer from one compartment to another 
(e.g., the transfer of a pesticide from stored honey into cell wax or vice versa). In 
fugacity models, these transport parameters are described as advection parameters 
(mass time-!) and as a mass transfer coefficient (mass surface"! time-!). For apply- 
ing them to the hive ecosystem, it is necessary to describe carefully and quantita- 
tively bee activities and material fluxes. 


8.2 QUANTIFICATION OF BEES’ ACTIVITIES 
FOR MODELING PURPOSES 


Productive honey bees and natural colonies present many substantial differences. 
Information reported here refers to typical productive honey bee colonies of Apis 
mellifera ligustica because the goal of this modeling application is the preven- 
tion of the contamination of bee products in relation to food safety. However, the 
same scheme can be applied to natural hives modifying the quantitative param- 
eters when necessary. An extensive description of natural bee characteristics 
is reported by Seeley [30], while that of productive honey bees is reported by 
Chauvin [31], Grout [32], Snodgrass [33], Root [34], and Goodman and Fisher 
[35]. In addition, remaining information was taken from personal communica- 
tions with bee experts. 


8.2.1 Bee Biorocv: DEVELOPMENT, REPRODUCTION, AND RENEWAL 


Bee development passes through egg, larval, and adult stages. Egg deposition begins 
in January—February with around 1,000 eggs. Later, this number soars to a peak of 
30,000—40,000 in May-June and finally declines gradually throughout the remain- 
der of the summer, ceasing in September-October. Hatching happens 3 days after 
deposition, and the larval development completes in 21 days in the wax cells. Larval 
dimensions range from 1.5 mm (near the egg size) to the size of the cell in the final 
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stage. Given a mean weight of 75 mg and an approximate volume of 90 mm? (1/4 of 
the cell volume), the density of larvae is about 0.83 mg mm š. Brood rearing begins 
in late winter with around 75 g of brood (nearly 1,000 cells containing brood). Later, 
brood rises to about 2.5 kg (30,000—40,000 larvae) in May-June and finally declines 
gradually until October. The total brood production is 15 kg year"! (corresponding 
to 200,000 larvae). 

Adult bees are specialized for different tasks depending on their sex and age. 
The majority of bees are sterile females (worker bees, ranging in number from 
10,000 in winter to 50,000 or even 100,000 in June). Worker bees 0—2 days old 
clean the cells (age caste I, cell cleaner); bees 2-11 days old care for the brood liv- 
ing in the central part of the nest (age caste II, broodnest caste); bees 11-20 days 
old constitute a food-storage caste, whose tasks occur in the peripheral, food- 
storage region of the nest and that are able to produce wax (age caste III); and bees 
20 days old or more become forager bees whose work is mostly outside the nest 
(age caste IV). Approximately 2096 of forager bees spend a day or two serving 
as guards at the nest entrance (guard bees). The biological cycle of worker bees 
varies from 40 to 45 days in summer to 6 months or more in winter. The mean 
dimensions of a worker bee are 12-13 mm in length, 4 mm in width, and 130 mg 
in weight. Given a volume of approximately 160 mm, the density of a bee is about 
0.8 mg mm”. 

Male bees are intermediate in size between workers and the queen. They are 
much less numerous than worker bees (numbering between 1,000 and 5,000 depend- 
ing on the period) and are important in reproductive activity with the queen, in hive 
thermoregulation, and in food exchange and transport within the hive. From a quan- 
titative point of view, they have a limited impact consisting of around 1046 of the 
sterile females. 


8.2.2 RECRUITMENT OF MATERIALS 


Bees may explore about 300 ha of territory daily (with a foraging radius from | to 
more than 5 km) searching for food resources. Bees need only four resources for 
their subsistence: nectar, pollen, water, and resin. The average amounts collected 
yearly by a colony are 240, 30, 10, and 0.1 kg, respectively, for nectar, pollen, 
water, and resin. Nectar is the base material for honey production. Nectar and 
honey are 20%—40% and 80% sugar solutions, respectively. Honey has a density 
of 1.39-1.43 kg dm [36]. Water is gathered for diluting honey for brood food and 
for evaporative cooling of the nest on hot days. Resins are the base materials for the 
production of propolis, which is composed of roughly 70% resin, 25% beeswax, 
and 546 volatile oils. Resins are taken from trees and carried home in pollen bas- 
kets. Propolis serves to plug unwanted openings and for hygienic purposes because 
of its antimicrobial and antifungal activity [37]. 

Another important material needed by bees is oxygen. Inside the hive, thermo- 
regulation and other bee activities require a large energy supply and create great oxy- 
gen demand. The overall oxygen consumption of a hive has been quantified as 30 kg 
year with the production of 52 kg year"! and 34 kg year"! of CO, and H,O, respec- 
tively. The yearly amount of materials collected by bees is reported in Figure 8.2a. 
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FIGURE 8.2 (a) Quantification of the material recruitment, (b) quantification of the hive 
products, and (c) year trends of the average amounts of hive compartments. All graphs are in 
logarithmic scale. 


Nectar, pollen, and oxygen are the most abundant recruited materials, then water 
is highly requested when metabolic and nectar water are not sufficient. Resin is 
collected at a very low level. 


8.2.3 Bee PRODUCTS 


Bees collect or produce six major products: honey, pollen, propolis, royal jelly, wax, 
and bees themselves (larval production). The typical honey reserve in summer is 
15 kg, and the total amount produced in a year is about 80 kg, of which 60 kg year"! 
is consumed for colony maintenance (25 kg in winter and 35 kg in summer) and 
20 kg year”! is typically removed by the beekeeper. Pollen is carried to the hive and 
stored by mixing the dry pollen grains with liquid (honey, nectar, or both). Pollen is 
generally composed of 10%-—20% water, 10%-35% proteins, 15%—40% sugars, and 
1%-10% lipids. The typical pollen reserve in summer is 2 kg, and the total amount 
foraged in a year is 30 kg. Honey and pollen are the primary food sources; honey fur- 
nishes energetic support and pollen supplies proteins, vitamins, fats, and minerals. 


160 In Silico Bees 


Daily food consumption depends on age and bee activity. The daily food intake of 
larvae ranges from a few milligrams in the initial days to tens of milligrams dur- 
ing the final stage. During the first 3 days, larvae are fed with about 3 mg day of 
royal jelly. Later, the larval food changes in composition based on age. However, in 
order to define a mean value for the full larval period, we assume consumption of 
12 mg day" of larval food composed of 50% honey and 50% pollen. An adult bee 
consumes food in proportion to its activity. During flight, about 6.77 mg of sugar is 
consumed per hour. Because a foraging bee is able to carry 10—20 mg and 40—60 mg 
of pollen and nectar, respectively, bees must make efficient choices of the most 
promising foraging areas in order to optimize the cost-benefit balance. We assume 
an average consumption of 10 mg day"! of honey and 1 mg day“ of pollen for adult 
bees. Propolis is used as an antiseptic agent and is a permanent material of the hive 
system present in variable amounts depending on the needs of the hive. We assume 
an average quantity of 0.3 kg with a renewal rate of 0.1 kg year~!. Royal jelly is used 
for high-quality nutrition (queens and first-stage larvae) and is not stored in the hive 
but produced upon demand. We estimate an overall annual consumption of about 
0.55 kg (10 and 540 g for the queen and larvae, respectively). These values are based 
on an average daily consumption of 20 and 1 mg for the queen and larvae, respec- 
tively. The queen (one individual) consumes this amount daily almost all year, while 
larvae (180,000 reared individuals) consume this amount for 3 days only. Royal jelly 
is generally composed of 57%—70% water, 6.4%-17% proteins, 6.896—2096 sugars, 
1.3%-7.1% of lipophilic substances (phospholipids, sterols, phenols, fatty acids, 
glycerides, and waxes), and 0.75%-1.1% minerals and other minor constituents and 
has a mean density of 1.1 g cm? [38]. Wax is the structural material of the hive, and 
its quantity is nearly constant throughout the year. The average quantity of wax is 
1.5 kg, most of it remaining for a long time. Bees further minimize the need of new 
wax by constantly recycling it. New wax is produced in abundance when a colony 
needs additional storage space for a large crop of honey. Bees continuously remove 
part of the wax (uncapping activity) and rebuild it (capping, fixing, and rebuilding 
activities). The amount of newly produced wax can be evaluated yearly based on the 
amount of cap wax (0.15 kg). The surface area of the wax cells (empty or full) can be 
evaluated by multiplying the internal surface area of one cell (360 mm?) by the total 
number of cells (100,000). The resulting surface area of the wax cells is 36 m?. The 
exchange surface of honey, pollen, and brood is equivalent to the proportion of the 
wax surface occupied by each component. 

A colony is able to rear up to 200,000 bees annually (including 5,000—20,000 
males and a few queens), consuming a total of 20-26 kg of pollen (130 mg of pol- 
len are required to produce an adult bee) and 20—30 kg of honey (one honey cell is 
necessary to rear several larvae). A typical nest contains about 100,000 cells with 
415 cells dm on each side of the comb. Each hexagon-shaped cell typically has a 
perimeter of 18 mm and an area of 24 mm", and the wall-to-wall distance is 5 mm. 
Cell depth is variable; considering a depth of 15 mm and an area of 24 mm’, the 
volume of a typical cell is about 360 mm?. Root [34] reports cell volumes varying 
from 360 to 192 mm? depending on cell density (650—1,050 cells dm? for both sides 
of the comb). In summer, two- to three-fifths of the cells are filled with brood, two- 
fifths with honey, and less than one-fifth with pollen. A typical nest is arranged in 
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10 combs, each with external dimensions of 47 x 30 cm and wax foundation dimen- 
sions of 44 x 27 cm, giving a total surface area of 2.4 m?. Cell walls and bases have 
only 0.073 x 0.008 and 0.176 x 0.028 mm of wax thickness, respectively. Based on 
these dimensions, rapid diffusion of pollutants is expected. The combs are com- 
posed of a total of about 1.4 dm? (1.35 kg) of wax. With the cap wax (0.15 kg), the 
total amount of wax in a typical nest is about 1.5 kg. Wax is a complex blend of 
straight-chain monohydric alcohols esterified with carboxylic acids and hydroxy- 
carboxylic acids mixed with various straight-chain alkanes. The density of wax is 
0.958—0.970 kg dm 3. 

The year amounts of bee products are shown in Figure 8.2b. Honey and pollen are 
produced in high amounts together with bees, and much lower levels are necessary 
for wax and royal jelly. Production of propolis is very low. 


8.2.4 ENVIRONMENTAL PARAMETERS WITHIN THE HIVE 


Environmental conditions within the hive are quite peculiar. In the proximity of 
brood, bees maintain a constant temperature between 34.5°C and 35.5°C also in 
winter. Far from brood or in its absence, temperatures fluctuate. In winter, bees are 
able to maintain near 20?C around them using metabolic heat. The high tempera- 
tures in the brood nest accelerate the diffusion of contaminants within the hive. The 
intense exchange activity of bees for food supply and social communication further 
increases the distribution of any contaminants that may be present. 

Another important parameter is the air flux into the hive for thermoregulation 
and for oxygen supply. The oxygen request (30 kg year!) corresponds to an air flux 
of 150 m? year-!. Considering that the air volume inside the hive is about 0.2 m?, the 
daily air flux (0.4 m? day!) results in a twice-daily exchange of the full air volume. 


8.2.5 YEAR Cycle or Bee ACTIVITY 


An indicative quantification of the year cycle of the hive compartments is reported 
in Figure 8.2c. Throughout the year, some materials are almost permanent (wax 
and propolis), while others are highly variable such as food storages that reach 
their minimum in January—February. Larvae and adult bees start to increase from 
February (1,000 larvae and 10,000 adult bees) until June (30,000—40,000 larvae 
and 50,000—100,000 adult bees), and then they decline until October when brood 
rearing stops. These numbers can be transformed in mass and volume data by 
means of the mean weight and density of each stage. In February foraging activ- 
ity starts again, and storages of pollen and honey rise slowly from 0.1 and 1 kg, 
respectively, in February until 2 and 25 kg in May-June when they reach their 
maximum. Royal jelly is almost absent as storage material, but it is produced upon 
request for the queen and for few-day-old larvae. From August, food storage slowly 
declines because of the reduction in environmental availability (daily flux into 
the hive), while the daily consumption is still high because of the high numbers 
of adult bees and larvae. From August, adult bees and larvae decrease, and brood 
rearing ceases in October. From this moment, only adult bees are present in the 
hive surviving as individuals from October to February and consuming mainly 
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stored food (winter storage of honey) for themselves and for the next generation 
reared in February. 

Throughout the year, wax and propolis can be considered substantially constant, 
while bees, larvae, honey, and pollen change, depending on the hive conditions and 
on the season. In order to simplify their variability, which is hive- and year-specific, 
a general parabolic trend depending on the season was chosen for each compartment. 
Therefore, the following second-order equations in function of the number of days 
(x) from January 1 were proposed for describing quantitatively the year trend of these 
compartments: 


Bees (kg) = — 0.0002: x° + 0.0752: x+ 0.3 (8.1) 
Larvae (kg) = — 0.0002: x’ + 0.070: x- 2.6 (8.2) 
Honey (kg) = — 0.007: x’ + 0.27: x (8.3) 
Pollen (kg) = — 0.00006: x° + 0.0214- x (8.4) 


These equations predict compartment dimensions with R? values of 0.71, 0.80, 0.70, 
and 0.68 for bees, larvae, honey, and pollen, respectively, referring to the 12 indica- 
tive data reported in Figure 8.2c. Larvae amount is 0 from November | to the middle 
of February and then follows predictions of Equation 8.2. By these equations and 
considering constant wax, propolis, and air compartments, the main hive compo- 
nents can be quantitatively described throughout the year on a day basis. The mass 
unit of Equations 8.1 through 8.4 can be transformed to a volumetric unit by means 
of their densities. 


8.3 MATHEMATICAL EQUATIONS FOR PREDICTING 
THE FATE OF MOLECULES IN THE HIVE 


8.3.1 PARTITION PARAMETERS BETWEEN HIVE COMPARTMENTS 


In the hive, several compartments are quite persistent: first of all, the wax one is 
almost permanent, and only a small fraction is ex novo built or re-elaborated by bees, 
especially when stored food is deposited or consumed (capping and uncapping activ- 
ities). Honey and pollen are also stored inside wax cells for months, and larvae itself 
stay within their cells for the time of their development (21 days). These quite long 
periods make possible a consistent transfer of contaminants between compartments 
by diffusion following the concentration gradient and the partition characteristics 
of the compound. The time to reach equilibrium by diffusion is generally long and 
depends on the media (viscosity), molecular characteristics, diffusion length (thick- 
ness), and temperature. In the case of several hive compartments, their thickness is 
very thin (e.g., cell walls), the time for partitioning is quite long, and the temperature 
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is high (near 35?C). These conditions facilitate consistent contaminant exchanges by 
diffusion, toward equilibrium conditions. Wallner [16] experimented over a 30-day 
period a consistent transfer of coumaphos residue from wax to honey. From these 
data and from others, reporting concentration measurements in honey and wax after 
acertain time from the pesticide application, experimental wax/honey partition coef- 
ficients (K,,) were calculated supposing that near-equilibrium conditions were pres- 
ent. Tremolada et al. [28] reported mean log K,, of 2.7 x 0.66, 2.7 x 0.50, 3.2 + 0.95, 
and 2.8 +0.72 for coumaphos, malathion, fluvalinate, and bromopropylate, respec- 
tively. As wax is a hydrophobic material and honey a hydrophilic sugar solution, K, 
is comparable to K, (octanol/water partition coefficient), but a direct correlation 
was not attempted, because of the variability and the scarcity of the experimental 
data. Waiting for a more extensive experimental data set, these authors calculated 
K,,, by a theoretical approach, using fugacity. In this way, a partition coefficient (the 
mass ratio of a compound in two phases at equilibrium) is equal to the ratio between 
the capacity of the two compartments, intended as the amount of a compound that 
is retained by the unit of volume at the same fugacity (equilibrium condition). The 
unit of capacity is mol m^ Pa~! and its symbol is Z;. Therefore, K,, was calculated as 
Za! Zi, Where the fugacity capacity of wax (Z, was calculated throughout K,, 
(organic carbon/water partition coefficient) and that of honey (Z,,,.) throughout the 
capacity of water to which an additional capacity was added, for taking into account 


that honey has an extractable lipid residue of 0.02% on fresh weight: 


Zoo Koc OCfwax Pwax (8.5) 
H 
Zroney = Zwater : 0.9998 + Zax : 0.0002 (8.6) 
where 
Zyater 18 equal to 1/H; 


H is Henry's law constant in m? Pa mol-!; and 
K, is the organic carbon/water partition coefficient calculated by the relationship 


log K,.—log K,,, — 0.21. 


OW 


The organic carbon fraction of wax (0cf,,,) was approximated to 0.57, and the 
density of wax (p...) was fixed to 0.97 g cm, according to literature indications. 
Predicted log K, values for coumaphos, malathion, fluvalinate, and bromopropylate 
were in the range of 2.7 and 3.2 as the experimental ones. Using these partition 
coefficients and their Z-values and adding to them the air compartment (Z,;,=1/ 
RT, where R=gas constant, 8.314 Pa m? mol"! T-!, and T=absolute temperature), 
a level I fugacity model was proposed [28]. Based on physical-chemical properties 
of pesticides and on the amounts that persist in the hive | month after application, 
predicted concentrations in wax and honey of coumaphos, malathion, fluvalinate, 
and bromopropylate were calculated. Predicted concentrations accorded quite well 


with measured data [28]. According to this work, this very simple “hive model” was 
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further developed [29]. These authors took into account all the compartments that 
are present in the hive and the materials recruited and produced by bees. Nectar was 
considered more similar to water than honey because it is a more dilute sugar solu- 
tion (20%—40% of sugar), and therefore it was approximated to water. 

Bees and larvae were considered by their lipophilic and hydrophilic composi- 
tions, and their compartment capacity was derived by K,,, and by that of water: 


oW. 


[say fiis Ka Tinte (8.7) 


The extractable lipid fraction of bees and larvae (lip,,,, and lip;,,,,,) was evaluated in 
0.02 (g lipid g-! fresh weight of animal). 

Pollen and royal jelly were considered similarly taking into account their typical 
compositions: 


Z pollen = water ` 0.15+ Kon Bin (8.8) 


Zs Liste 0054 Kou (8.9) 


From literature data, the average lipid fraction of pollen and royal jelly (lip ponen and 
lip,) was 0.05 and 0.04, respectively (g lipid g! fresh weight of product). 

Propolis is mainly composed of resins (70%) and wax (25%); therefore it was 
considered analogous to wax using K, 


Z uui _ — Ppropolis (8.10) 


The organic carbon fraction of propolis (0cf, polis 
density (P,,opotis) to 1 g cm. 

All these compartments were considered basically by their water and lipid content 
in order to represent their affinity for hydrophilic and hydrophobic compounds. At 
the moment, an indirect validation of these capacities is derived by their application 
to a case study of the fluvalinate distribution in the hive [29,39]. 

In order to simplify the model, several hive compartments (e.g., honey, wax, prop- 
olis) can be considered together in a multicompartment: the “bee product" one. The 
larvae can also be considered a bee product because they are reared by bees within 
the wax cells (continuous contact with wax and adult bees) and because they are fed 
with bee products: royal jelly first and larvae food later. Because of this common 
origin, their contamination can be highly dependent on that of bees, and they can be 
grouped together in a bulk compartment (bee products), whose capacity (Z,,,) can 
be calculated by the sum of the capacities of the single components multiplied by 
their relative volume fraction (vf): 


) was approximated to 0.57 and its 
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Z prod = Zroney Vins; + Z wax VÍ as + Z pollen Vl gaan T Z propolis Vf propolis + Ziarvae Vfiarvae 


(8.11) 


Among bee products, pollen is peculiar because it is transported into the hive exter- 
nally in pollen baskets and then it is stored in the wax cells nearly as it was originally 
(the contact with bees is limited), but its residence time in wax may be long, allowing 
contaminant exchanges with wax by diffusion. Therefore, it was decided to group it 
with the other bee products. 

Royal jelly is not included in this bulk compartment because it is mainly pro- 
duced on request and not stored in the hive: its volume fraction can be approxi- 
mated to zero. Grouping all the bee products together allows reducing much of the 
number of compartments that may have different fugacity. By this solution, only 
three distinct bulk compartments were considered (air, adult bees, and bee prod- 
ucts), having their own bulk capacities and fugacities (Z, Zpees Zproas and fairs Sheer 
foroa» respectively). 

Contamination sources can be different (cfr. 1.1): from the air as in the case of 
neonicotinoid insecticides or from bees as in the case of direct pesticide treatment 
into the hive. Several treatment modalities use a medium in order to deliver the pes- 
ticide into the hive (e.g., Apistan strips carrying the active ingredient t-fluvalinate). 
From this medium, the pesticide slowly migrates into the hive. The pesticide release 
depends on the medium's capacity to retain it inside, which depends on the affinity of 
the material to the pesticide characteristics. Because treatment media are often made 
of plastic materials or wood, they were modeled using K,,: 


K< OCf reat Pret 


| (8.12) 


Zret = 


The organic carbon fraction of the treatment medium (0cf,,,,,,.) was approximated to 
0.57 and its density (Prea) to 0.9 g cm. 


8.3.2 QUANTIFICATION OF CONTAMINANT FLUXES IN AND OUT OF THE HIVE 


Contaminants may enter the hive in four main ways as shown in Figure 8.3: by the 
air flux, if the contaminants are dispersed in this medium; by external food sources, 
if these materials are contaminated [19]; by foraging bees, if they come in contact 
with contaminated media [8,18]; and by chemical application within the hive [16]. 
These multiple contamination sources can be described as D-parameters within the 
framework of multicompartmental fugacity models [24]. These D-values are flux 
parameters with the unit of mol day! Pa^!, and they refer to three different pro- 
cesses: mass fluxes (advection D-values), diffusion events (exchange D-values), or 
degradation processes (reaction D-values). Although D-values refer to these different 
processes, they have the same units, and therefore they are directly comparable for a 
given system (in this case, the hive ecosystem). 
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FIGURE 8.3 | Modeling of the contaminant input and output for the hive ecosystem. 


The advection of a compound by air (D,,,,.;,,) was calculated by the air flux into the 
hive for oxygen supply (Gi, ;, u> Which was quantified in 0.41 m? day!. The outflow 
of air is clearly the same amount, and therefore the D is equal to D 


air-out air-in* 


Dair-in = Dar.ou = Gsr-in-out Zur (8.13) 


The contaminant inflow by this way (mol day") is defined by the product of the D,,,, ;, 
by the fugacity of the air out of the hive (7; ,,,, in Pa), which is a function of the con- 
taminant concentration of the outside air (C in mol m >: 


air-out 


Cro 
fair-out = Z= (8.14) 


The atr inside the hive can be contaminated also by volatilization from the treat- 
ment medium in the case of a direct pesticide application into the hive. This advec- 
tion flux (D orrea) can be calculated by diffusion, using a double-layer resistance 
approach with two specific mass transport coefficients (MTC, and MTC ear for 


air and treatment-medium side, respectively). Volatilization depends also on the 
diffusion area (Apear: 


Aret 
1/( MTC, i Zär )) + (1/( MT Creat Zee) 


Dyol-treat = (8.15) 


MTC, 


air 


and MTC 


treat 


were quantified in 1 and 0.0001 m day! [29]. MTC,,, was 
derived from already published data [24], while that of treatment medium was ex 
novo evaluated by the authors. 

In the case of direct pesticide treatments into the hive, the contamination derives 
also from the contact of bees with the treatment medium or from the ingestion of the 
treatment solution (in the case of liquid medium, e.g., Perizim). 


Mathematical Models for Hive Contamination 167 


The transfer of a pesticide by contact between the treatment surface and bees was 
evaluated by the following equation using the specific MTC (MTC ear and MTC,,,, ij). 
Both of them were considered having very low values (0.0001 m day!) [29]: 


Avet 
1/( MT Creat Zeeat)) + ac MT Chess-kitin Zi.) 


(8.16) 


Deontact-treat = ( 


The contact area between bees and the treatment surface (A eat) is roughly approx- 
imated to that of the treatment medium, but often this one is placed in between 
frames where a limited space is available, causing a lot of inadvertent contacts and 
making bee work more difficult. For this reason, bees are probably induced to reduce 
the strip interference, for example, by gluing them down to one frame with wax, to 
make for easier passage. The potential capacity of the treatment medium to release 
the pesticide by contact is probably constant during the treatment, but its efficacy 
probably declines over time because of the reduced actual contact between bees 
and the treatment area. This would also reduce pesticide transfer from the treatment 
medium to the bee compartment. Mathematically, this behavior was modeled by an 
exponential relationship of the contact area between the treatment medium and bees 
versus time (f) (A,,,, = 0.012 x e7!?6*"), This equation was justified by experimental 
results of bee contamination after treatments with a pesticide acting by contact (e.g., 
Apistan strips). In this case, experimental concentration showed an initial contami- 
nation peak in bees during the first day after treatment followed by a slow decrease 
even when the treatment lasted for 1 month [39]. 

Another direct contamination pathway is the ingestion of the treatment solution 
when the pesticide application is performed by a solution/suspension. In this case, 
the input flow (mol day~') was quantified by the product of the ingestion capacity of 
bees (Gingestion in m? day ') and the pesticide concentration in the treatment solution 
(Creat in mol m). This concentration becomes zero when the treatment ends. The 
ingestion capacity of bees can be calculated by multiplying the ingestion capacity 
of each bee (50 mg as in the case of a foraging bee with nectar) by the number of 
bees taking care of the hive (10,000), assuming that the density of the pesticide sus- 
pension is about 1.0 g cm 2. The ingestion time of a single bee is rapid, but all bees 
cannot ingest the treatment solution simultaneously. Therefore, the overall ingestion 
time is much longer, on the order of many hours. In the model, 24 h are assumed 
as the time required to fill the overall ingestion capacity of bees, giving a value of 
0.5 dm? day"! as the overall ingestion capacity (Gingestion): 

The contamination can also be caused by the contact of foraging bees with con- 
taminated vegetation (e.g., during pesticide spraying to agricultural crops). This 
advection flux (Deontact-veg) can be modeled by diffusion between the vegetation 
surface and that of bees: 


Pes 
V(MTC,s Zereat)) + (1/(MTChes-ktin Zoos) ) 


Deontact-veg = ( (8.17) 


A crucial parameter is the area of bees in contact with the vegetation. Considering 
that a single bee comes in contact with the plant surfaces during its foraging 
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activity, Barmaz et al. [20] proposed a representative contact area of 5 cm? bee"! 
for each foraging flight, and supposing five flights in a day, this surface became 
25 cm? bee“! day". Multiplying this value for the number of foraging bees (1/3 of 
the total), the daily contact area between bees and vegetation was derived (33 m?). 
Barmaz et al. [20] suggested, as worst case, that the contamination from the veg- 
etation surface can be calculated multiplying the contact area by the contaminant 
amount deposited onto the vegetation (mol m?). In this case, the whole amount 
present on the vegetation surface is considered to be transferred to bees. Even if 
bees are protected by a chitin skeleton, which limited the contaminant uptake, 
they are characterized also by a thick hair cover around the body and by a wide 
tracheal system, which has a high capacity of gas exchanges. Respiratory sur- 
faces can also efficiently take up gas- and particulate-phase contaminants, so that 
the contaminant deposited on the plant surfaces can be efficiently transferred to 
the bee body and absorbed via the respiratory system. Alternatively, the amount 
of contaminant taken up by bees from the vegetation can be calculated on the 
basis of a diffusion process by Equation 8.17, in which the transferred amount 
depends on the two MTC values (MTC,,, and MTC,,,, ,;,;,) that were set to 0.001 
and 0.0001 m day^!, respectively, and in this case, the amount of contaminant 
taken up by bees is much more limited. Further experimental trials are necessary 
to clarify this contamination source. 

Another input pathway is the advection of a compound inside the nest via food 
and materials foraged by bees. These advection parameters are defined by the fol- 
lowing equations in which the G-values are the flux of materials in m? day-': 


Dhetariin = Grectariin Zret (8.18) 
D pollen-in = Gpotier-in Z pollen (8.19) 
Diaia-in = Guerin Zwet (8.20) 
D;esn-in = Gresn-in Zpropalis (8.21) 


Fluxes of nectar, pollen, water, and resin were quantified as 1.33, 0.167, 0.0555, and 
0.000555 dm? day-!, respectively, and the amount of contaminant entering in the hive 
with these materials is defined by the product of these D-values by their fugacity 
(ShectarrSpoltenr fwaters and fesi). These fugacities are derived from the concentrations of 
the contaminant in each material as shown in Equation 8.14. 

The output pathways that are able to reduce the hive contamination (Figure 8.3) 
are those regarding the air compartment (D,,, ,,,,) as previously defined, the bee com- 
partment (bee renewal and bee metabolism), and the bee product compartment, in 
the case of collection of materials by the beekeeper. 

When adult bees end their life cycle, they usually die far from the hive or, 
if they die inside, they are thrown out by worker bees. In this way, bee renewal 
causes the outflow of contaminants that were contained in the bodies of dead bees. 
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This advection flux is quantified by D,,,,,, obtained by the daily bee renewal 
(G,,,.,,,) of 0.142 dm? day"! (each bee has an individual volume of 160 mm? and a 
life cycle of 45 days): 


Dire = Goeeren Locos (8.22) 


The loss of contaminants by bee metabolism is quantified by D,,, ,,,,, which is based 
on the biotransformation rate constant in bees (&,,, ,,,, in day), the volume of bees 
(Vrees in m°), and the bee capacity (Z,,,, in mol m? Pa): 


D bee-met — Kpee-met Voces Z bees (8.23) 


Contaminant removal by the material collected by the beekeeper is quantified by 
the terms: D,,,,,,, D D D, a| and Dpropotis-ou quantified by the cor- 
responding G; ,,,-values (m? day!) as in Equations 8.18 through 8.21. The type and 
amount of product withdrawals depend on the rearing practices and on the beekeeper 
choice; the model allows for evaluation of the contaminant output for the different 
alternatives in quantity and the type of materials taken out. 


wax-out* ^^ pollen-out* 


8.3.3 QUANTIFICATION OF INTERCOMPARTMENT EXCHANGES WITHIN THE HIVE 


Once a pollutant reaches the hive, it can be dispersed by contact if the contamination 
is on the bee surface or deposited in storage cells if the contamination is within for- 
aged materials. Wax can be contaminated directly by contact or indirectly through 
the cell contents. Air is in contact with bees and wax and can act as a redistribution 
medium inside the hive, especially for volatile compounds. Once a pollutant is stored 
in honey and wax, it is unlikely to degrade because these compartments are micro- 
biologically stable. The pollutant can be recirculated when these products are used 
by the bees for their nutrition or for that of larvae. 

Bees and air act as redistribution media with different efficacy depending on the 
compound properties: for example, for a low-volatile compound, contained mainly 
in wax, honey, or pollen, bees are the main redistribution pathway. Bees take up the 
contaminant when they feed on honey and pollen or when they work on wax, and 
they give it back when they feed the larvae or when they deposit newly secreted wax. 

Considering the three compartments (air, bees, and bee products), all the exchange 
fluxes among them can be described by a specific D-value, as shown in Figure 8.4. 
When a given process determines the transfer of a certain amount of a contaminant 
from one compartment to another, this process determines an output flow for the first 
(giving) compartment and an input flow for the second (receiving) compartment. For 
example, D,» which represents the pesticide volatilization from wax to air, deter- 
mines an output flow from wax and an input flow to the air compartment. 

For the bee compartment, the major input flows within the hive come from the 
consumption of contaminated honey and pollen stored in the hive (D,,,,, ,,,, and 
D ) for their feeding and for the food preparation for the larvae and the queen. 


pollen-cons 


In addition, bees inherit a contaminant residue from the larvae from which they are 
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Contamination exchanges inside the hive 
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FIGURE8.4 Modeling of contaminant exchanges within the hive ecosystem. 


formed (Dyaryac-res) and uptake it from the air through the respiratory surfaces (D,,). 
These D-values were defined as follows: 


Dhoney-cons = Ghoney-cons Zroney (8.24) 

D polten-cons = G polien-cons Z polien (8.25) 

Diae res = Gianweres Ziarvae (8.26) 

Dys Daa Ares (8.27) 


ar MTCi, Zi; ) * ac MTCis. res, Ziel) 


Summer honey and pollen consumption (G,,,,,..,,, and Gyotien-cons) were estimated 
into 0.286 and 0.04 dm? day~', respectively, basing on an adult bee number of 40,000 
and on an individual need of 10 and 1 mg bee" day“! of honey and pollen, respec- 
tively, normalized by their densities. Mean larvae flux (Garvae-res) of 0.0675 dm? day! 
was calculated based on an individual volume of 90 mm? larvae !, the whole lar- 
vae number produced in a year (180,000 larvae), and the production period from 
February to October (240 days). 

The absorption and desorption from the respiratory surfaces of bees were calcu- 
lated considering the respiratory surface of a single bee (9.1 cm? bee), the mean bee 
number in summer (40,000 bees), and the air- and the bee-respiratory-side MTC of 
1 and 0.01 m day", respectively, according to Mackay [24]. The respiratory surfaces 
of bees were evaluated indirectly knowing that the oxygen consumption of bees dur- 
ing flight is 5 mL of oxygen per hour, which corresponds to 641 mL of oxygen per 
kilogram of body weight per minute. It is known that the tracheal system and air sacs 
of bees are characterized by a high exchange area [33], but quantitatively this datum 
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is not available. In the absence of specific data, the respiratory surface of bees was 
estimated by a proportion with the exchange surface able to furnish oxygen to man. 
During intense sporting activity, a man consumes 94 mL of oxygen per kilogram 
of body weight per minute using an oxygen exchange surface of 50—90 m?; even if 
this extrapolation is highly approximated, a respiratory surface of 9.1 cm? bee-! was, 
proportionally, calculated. 

The bee compartment releases the accumulated contaminant by the production of 
wax, honey, larvae food, and royal jelly (D pax-proo Phoney-prod» Ptarvae-foodr and D, ; 
and by the release of the compound into the air through the respiratory surfaces 
(D, as defined in Equation 8.27). The release of contaminants via the respira- 
tory surface happens in the same way that absorption happens, but the net amount 
exchanged depends on the relative contamination levels of air and bees and thus on 
their fugacities. 

The other contaminant released from bees through their products was quantified 
as follows: 


Dene prod = Gu prod Zuex (8.28) 
Dicney-prod = Ghoney-prod Zhoney (8.29) 
Diarvae food = Giarvae food Ziarvae food (8.30) 
Dip a (8.31) 


The amounts of honey, wax, larvae food, and royal jelly produced daily by bees 
were evaluated as 0.238, 0.000648, 0.178, and 0.00231 dm? day-!, based on a total 
honey production of 80 kg year-!, a cap wax production of 0.15 kg year-!, a larvae 
food production of 25 kg year! of honey and 25 kg year"! of pollen, and a royal jelly 
production of 0.61 kg year-!. All these year productions were divided by 8 months of 
activity (240 day year). 

For the “bee products" compartment, the major input flows come from contact 
with bees (Deontact-bees)> deposition of contaminated wax, honey, larvae food, and 
royal jelly (Dyaxproaw Dhoney-proar Diarvae-fooa and D and deposition from the air 
(Daep). The major output flow results from the production of new bees from lar- 
vae (Drarvac-res)» from the consumption of honey and pollen (Dagney-conss Dootien-cons? 
and D,,,,,, ,,4), and from the volatilization of the compound to the air compartment 
(Do). The majority of these input and output flows were already defined for the bee 
compartment. Only Deoniact-beess Dvo and D,,, were not previously defined, and they 
were quantified as diffusion processes starting from the overall wax surface, which 
Is in contact with air and with bees, and from their relative MTC values: 


j- prod) 


Açex-bess 
1/ ( MT Coss utin Zees)) + (1/ (MTCyax Z)) 


Dcontact-bees = ( (8.32) 
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Dg = Dy = A 
mU QWMTCs Zair) + (VMTC ua Zi) 


(8.33) 


The wax surface in contact with air (A,,,) was geometrically calculated from the 
honeycomb surface (2.4 m?), while that in contact with bees (A... y. I was reduced 
to one-third because not all the wax surface is in contact with bees, even if the 
intense in-hive activities require a continuous wax-bee contact. Bee-chitin-, wax-, 
and air-side MTCs were set to 0.0001, 0.001, and 1 m day“, respectively. 

The wax surface was approximated as that of the 10 combs (2.4 m?) rather than 
that of the wax cells (36 m?) because most of the cells are capped or filled with food 
or larvae. Therefore, the surface of wax in contact with air was approximated to the 
plain surface of combs, as if all the cells were capped and as if this surface was plain. 
These approximations were considered acceptable. 

For the air compartment, the major input flows derive from the compound vola- 
tilization from wax (D, and from the release from bees to air through the respi- 
ratory surfaces (D, p. The major output flow results from the deposition from air to 
wax (D,,,) and from the uptake by the respiratory surfaces of bees (D,,). 


8.3.4 NON-STEADY-STATE Mass BALANCE OF INPUT 
AND OurPur FLOWS IN THE HIVE 


The overall balance of input and output flows among the hive compartments, which 
were reduced to three (bees, “bee products,” and air), was described by a system of 
three non-steady-state mass balance equations (one for each compartment) using 
fugacity ( f, units of Pa) as the unknown time-dependent variable (t=time, units of 
day). Non-steady-state conditions allow evaluating the evolution of the contamina- 
tion within the hive after a possible contamination event. The system of ordinary 
differential equations describing the contamination in the three compartments is as 
follows: 


ys = (D contact-treat Treat + G ingestion C in t D contact-veg Tin +D nectar -in rect +D water -in T water 
+D honey-cons T iod +D pollen-cons f prod T Diarvae-res foroa F D up fair -(D wax-prod 
+D honey-prod + Diarvae-food F D j_prod +D rel +D bee-ren + D bee-met ) fie )/V bee Z vee 
(8.34) 
Qf prod 


dt = ( Dpatein f ien "E Dizinin fresin + Deontact: bees foe + Dx prod foce 


T Dhongy-prod foce + Diarvaefood foee + D..;-prod free + Dae fair 


= ( Diarvaeres T Dhong-cons + D pollen-cons + Du ) foroa ) / Vorcct pre (8.35) 
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dfi _ ( Dair-in fout F Do -treat fireat + Du foroa + Dra foess m ( Dar.ou + Das + D) far) 
dt Var Zar 


(8.36) 


where 

f; is the fugacity with the units of Pa; 

D; represents the various D-values (advection, exchange, and degradation) with 
the units of mol day^! Pa^!; 

V, represents the compartment volumes with the units of m^; 

Z; is the compartment capacities with the units of mol m? Pa; 

fico foroa and f,;, are the fugacity of the compound in bees, bee products, and air, 
respectively; and 

f, a 1S the fugacity of the contaminant in the treatment medium determining a 
flux to bees by contact and to air by volatilization. 


This term is considered for pesticide treatments into the hive acting by contact (e.g., 
Apistan), while for treatments acting by ingestion (e.g., Perizin), the pesticide input 
is obtained by multiplying the ingestion capacity of bees (G gestion» units of m? day) 
by the pesticide concentration in the treatment solution (C;,, units of mol m). f, 
and f,,,,,, in Equation 8.34 and f,,,,,, and fresin in Equation 8.35 are the fugacities 
of contaminated nectar, water, pollen, and resin, respectively. In Equation 8.36, 
the term f,,, is the fugacity of the air outside the hive, if it is contaminated. These 
fugacity values (Pa) can be calculated by the ratio between the concentration of the 
compound in each medium (mol m^) and its capacity (mol m^? Pa~!) as shown in 
Equation 8.14. 

The differential equation system exposed earlier calculates day to day the 
fugacities in air, bees, and "bee products" as a result of input flows toward 
the considered compartment (D-values with positive algebraic signs) and out- 
put flows from the same compartment (D-values with negative algebraic signs). 
Output flows can produce an input flow toward another compartment, taking the 
contaminant inside the hive, or, if they are addressed outside, they constitute a 
contaminant loss. 

The contamination from outside can be derived from many pathways, each rep- 
resented by a specific D-value multiplied by its fugacity, which represents the inten- 
sity of the contamination. The input flow is addressed to the specific compartment 
that initially receives the contaminant. For example, D, ia and D which 
represent the eventual pesticide inputs from nectar and water, are considered as 
input flows only for the bee compartment, because nectar and water are effectively 
ingested by bees and not simply carried in external structures such as pollen baskets. 
These external structures are used by bees to carry pollen and resin, and the con- 
taminants present in these materials are deposited directly into the “bee products” 
compartment. For this reason, D,,oien-in and D are considered as input flows for 
the “bee products" compartment. 


water-in? 


resin-in 
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8.3.5 APPLICATION OF THE “Hive MopeL”: A Case STUDY 
WITH THE INSECTICIDE/ACARICIDE T-FLUVALINATE 


The equation system reported earlier was applied to a specific contamination trial 
[29,39]. The pesticide used was t-fluvalinate, a pyrethroid insecticide/acaricide com- 
monly used against the bee pest Varroa destructor. 

Following common treatment methodologies, the pesticide was administered by 
two plastic strips hung between combs for | month. From the strips, the compound 
passes to adult bees principally by contact, and from them the pesticide is able to 
reach the other hive compartments, including larvae too, in order to protect both 
adult bees and larvae. If bees are contaminated with fluvalinate, they tend to pro- 
duce contaminated products or to contaminate products by contact during handling. 
Once fluvalinate residues are transferred to bee products (wax, honey, pollen, larvae, 
and propolis), the products themselves become secondary sources of contamina- 
tion for bees. All of these exchanges can be mathematically expressed by the dif- 
ferential system of Equations 8.34 through 8.36, and using the physical-chemical 
properties and treatment conditions of t-fluvalinate, this equation system was able to 
quantify the pesticide fugacity in bees, “bee products,” and air, and from them, the 
concentrations in the different hive compartments as a function of time. Figure 8.5 
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FIGURE 8.5 Comparison of predicted and measured concentrations of t-fluvalinate in 
(a) bees, (b) wax, and (c) honey. 
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reports fluvalinate concentrations in bee wax and honey predicted by the model (con- 
tinuous lines), starting just before the treatment (Time 0) up to 180 days after it. 
Experimental data measured in the two experimental hives (hives 1 and 4) were also 
reported (dotted lines). 

Measured concentrations in experimental hives gave consistent results between 
them, and the two data sets drew quite clear time trends. Bees were not contami- 
nated before treatment; thereafter, their contamination level rose to a peak and later 
decreased to a nearly constant value (50 ng g! f.w.) until the end of the treatment 
(30 days). In contrast, measured concentrations in wax gradually increased after 
treatment, reaching a plateau slightly above 1,000 ng g' at 60 days after treat- 
ment. Measured contamination levels in honey were always below the limit of 
quantification of 2.5 ng g^. Predicted concentrations closely follow these trends, 
showing predicted levels near or intermediate between measured ones. Predicted 
concentrations for honey were always below the limit of quantification, according 
to measurements. 

The model predicts a rapid increase in concentration in bees just after treatment, 
as suggested by the measured data, which shows an initial high variability. This 
behavior can be explained considering that only a fraction of the bees working in the 
nest can simultaneously visit the treatment strips. Later, the general contamination 
of all hive compartments (secondary sources) and the reduced visitation of bees to 
the treatment strips (primary source) tend to make the concentrations in bees more 
uniform (as shown by measurements). Predicted data show a concentration peak in 
bees during the first few days of treatment and then slowly decrease because of the 
reduced contact between strips and bees. After 30 days, when the treatment strips are 
removed, concentrations in bees tend to decrease more rapidly because the primary 
pesticide source (the strips) is no longer present and secondary sources (contaminated 
hive products) remain. Predicted concentrations in wax and honey follow a slowly 
rising trend until about 60 days, according to the measured data. After removal of 
the strips, the hive products still receive the pesticide through contact with bees until 
their fugacity becomes equal to that of bees. Thereafter, concentrations in the hive 
products begin to slowly decline because, in the absence of new pesticide input, the 
various loss processes begin to reduce the overall contamination. Concentrations 
decrease more rapidly in bees than in bee products (wax and honey) because of the 
persistence of this pesticide in these compartments. Biotransformation and advection 
out of the hive by dead bees are the primary processes by which the pesticide is lost 
from the hive system. The slow decline of the contamination in wax is consistent 
with the observation of the wax contamination before the treatment, presumably 
derived from previous treatments at least 1 year before. 


8.4 CONCLUSIONS AND FUTURE PERSPECTIVES 


The presented “hive model" considers different contamination pathways: from out- 
side, such as the contamination coming from nectar, pollen, resin, water, air, and 
vegetation, or from inside via pesticide treatments against bee pests. It includes 
almost all the contamination threats toward bees, but, at the moment, it has been 
applied successfully to only a single case. However, as any initial scientific effort, 


176 In Silico Bees 


it can be very useful in indicating the most urgent research need. Analyzing the 
input data of the model, it uses the physical-chemical properties of the compound 
and the major characteristics of the hive ecosystem, from which it calculates con- 
tamination residues in bee products (honey, pollen, royal jelly, wax, and propolis) 
over time. While the physical-chemical properties of a compound are quite well 
known, the hive characteristics, important for contamination modeling, are much 
less known. Even among some well-known hive parameters, there is a certain level 
of uncertainty. Of course, the food consumption of adult bees depends on food avail- 
ability, bee age, and primary activities: bees that are preparing royal jelly require 
more pollen than those that are producing new wax. However, for modeling purposes 
referring to an average value of food intake is sufficient, and this average value may 
represent the material fluxes into the hive with a sufficient detail. For this reason, 
the hive parameters proposed in this chapter can be considered to be sufficiently 
supported by the present knowledge, even if it is clear that they may be improved 
and corrected. On the other hand, many more uncertainties exist in the evaluation of 
the contaminant behavior inside the hive. For example, the compartment capacities 
(Z-values) and the exchange parameters (D-values) described in this chapter have, at 
the moment, only been proposed and indirectly validated with a single case study. It 
is clear that much more experimental work is needed for better describing them and 
for supporting these parameters with experimental data. For example, the capacity of 
chemicals to cross the chitin barrier or the diffusion velocity in wax is unknown. All 
these values were quantified by a specific MTC parameter defined by similarity from 
others already proposed. Specific experiments of volatilization from wax, honey, and 
pollen or bee contamination from air should be performed with more experimental 
data and evidence to quantify these exchange parameters. A first step could be the 
experimental evaluation of the wax-honey partitioning, starting from contaminated 
honey or wax and lasting through the chemical diffusion process until equilibrium 
is reached. 

In the future, more experimental works could produce more experimentally based 
parameters, which can improve the present attempt of modeling the contamination 
of the hive ecosystem. A more validated “hive model” can be used in two ways: as 
a prognostic tool for assessing the possible contamination levels of bee products for 
voluntary contamination events (pesticide treatment into the hive) and as a diagnos- 
tic tool for understanding the contaminant fate of involuntary contamination events, 
such as those coming from outside. The “hive model" can be applied in order to 
test the contamination levels of different pesticides depending on their application 
modalities or to give unsuspected indications of severe contamination threat from 
outside. 
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ABSTRACT 


Honey bees are beneficial insects playing a key role in pollinating wild plants and 
crop plants. Unfortunately, during their foraging activity they can be exposed to 
pesticides and other xenobiotics. The members of the colony can also be poisoned 
indirectly by contaminated food and water brought back to the hive by foragers. 
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While the assessment of the potential adverse effects of a xenobiotic on individual 
bees can be easily done by using normalized laboratory tests, toxicity estimation 
at the population level suffers from technical difficulties and is costly. Fortunately, 
population modeling is increasingly used to overcome this problem of transition 
from the individual to the population level. In this context, an agent-based model, 
called SimBeePop, was designed for predicting the long-term effects of man-made 
chemicals on honey bee populations. After a detailed description of the structure of 
the model, its performances were estimated on pyriproxyfen, a juvenile hormone 
mimic. To do so, the physicochemical properties, environmental fate, use, and tox- 
icity of this insecticide to honey bees were reviewed in order to elaborate realistic 
scenarios of contamination. Application of these scenarios in SimBeePop reveal 
that while pyriproxyfen is classified as moderately toxic or not toxic to bees under 
current regulations, it can induce significant adverse effects on bee populations at 
sublethal concentrations. 


KEYWORDS 


Apis mellifera, Agent-based model, Population dynamics, Pyriproxyfen, Endocrine 
disruptor 


9.1 INTRODUCTION 


A challenge in ecotoxicology is the translation of individual-level effects of exposure 
to chemicals, as measured, for instance, in laboratory tests, into population-level 
effects that are more ecologically relevant. Yet, such population risk assessments are 
seldom conducted, due primarily to the technical difficulties they entail. Broadly 
speaking, the more complex the life-history trait of the studied organism, the more 
difficult, time consuming, and costly the risk assessment of its population. Fortunately, 
population modeling is increasingly being considered to overcome this problem of 
transition from the individual to the population level. Population modeling can easily 
integrate birth, development stages, reproduction, death, immigration, emigration, 
and coaction to predict the future behavior of a population or to detect short- or long- 
term adverse effects on population structure or productivity. Because there exist in 
silico simulation tools, these models can be used to test various hypotheses and 
scenarios in order to predict the outcome of some effects or to identify the most 
relevant variables [1—6]. The literature is full of reviews and case studies stressing 
the strengths and weaknesses of the various types of population models that have 
found applications in ecotoxicology [7-11]. These models can include more or fewer 
biological details related to population structure, physiological and toxicological 
responses, spatiality, temporality, stochasticity, and so on. The choice of a model 
paradigm is problem dependent. It basically depends on the accuracy needed for the 
question asked. Each type of model serves to answer specific questions while having 
different data requirements and assumptions to reach a sufficient level of realism for 
practical use. 

Thus, to study the endocrine disruption potential of xenobiotics on honey bee 
populations, we decided to use an agent-based model (ABM) [12] to account for the 
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multifaceted aspects that endocrine disruption phenomena might take [13] on the 
different inhabitants of a hive. 

Domestic bees (Apis mellifera) are less healthy and less abundant than they 
have been in the past. If this trend continues, it could have serious implications, 
since most plants rely on bees for their pollination. In the United States, the honey 
bee is responsible for pollinating $15 billion worth of agricultural crops each year. 
The California almond crop alone uses 1.3 million colonies of bees for pollina- 
tion, approximately one-half of all the honey bees in the United States [14,15]. The 
causes of decline are multiple and include environmental and climatic changes, 
the action of pesticides, pathogens, and parasites, intensive migratory beekeep- 
ing, and maybe the effects of radiations [16-21]. The direct and indirect effects 
of endocrine-disrupting chemicals also cannot be neglected because it has been 
shown that xenobiotics could affect the endocrine system of insects [22] and crus- 
taceans [23-25]. Because hormonal signaling regulates numerous processes in 
honey bees such as development, metamorphosis, reproduction [26,27], polyethism 
[28,29], and aggressiveness [30], we assumed that an ABM was the most suited 
modeling approach to encode these phenomena expressed at different spatio- 
temporal levels within a hive as well as their potential perturbations induced by 
xenobiotics. Indeed, conventional top-down modeling approaches, such as differen- 
tial equations, approximate the average behavior of a system as a whole. They gen- 
erally fail to correctly capture the different local relationships between the system 
components that can be the cause of high-level behaviors. On the other hand, ABMs 
are bottom-up modeling approaches that aggregate the different level components 
of the studied system to derive more realistic models [31,32]. Briefly, an ABM is 
constituted of a collection of autonomous decision-making entities called agents 
located within a defined environment. Each agent individually assesses its situation 
and makes decisions on the basis of a set of rules. Relationships between agents are 
specified, linking agents to other agents and/or components of the environment. 
These relationships can be simply reactive, the agents only performing tasks when 
triggered to do so by some external stimuli or, on the contrary, goal directed, the 
agents always having specific tasks to achieve. It is noteworthy that agents may be 
capable of evolving, allowing the emergence of unanticipated behaviors [12,33]. 
ABMs have been proposed to simulate the different activities of bees within and/or 
outside their hive [34—43]. 

In this context, this chapter presents an ABM that can be used to simulate the 
endocrine disruption potential of xenobiotics on bee populations. After a synthesized 
description of the main characteristics of the model, its potentialities in ecotoxicol- 
ogy modeling will be discussed from simulation results obtained with pyriproxyfen, 
2-[1-methyl-2-(4-phenoxyphenoxy)ethoxy]pyridine (CAS RN 95737-68-1), an aro- 
matic, nonterpenoid juvenile hormone agonist introduced by Sumitomo Chemical 
Co. Ltd in the 1990s [44]. Our motivation for selecting this insecticide was at least 
twofold. As it is mainly used in agriculture and in vector control, it is a potential 
contaminant for both terrestrial and aquatic ecosystems. As a result, it was expected 
to find enough environmental concentration data to run the model under realis- 
tic hypotheses of contaminations. Even more important, while pyriproxyfen is a 
juvenoid, on the basis of its oral and contact LD;, (lethal dose 50%) values, it is 
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currently classified as moderately or not toxic to honey bees [45—47]. Pyriproxyfen 
was also found moderately toxic against the leafcutting bee (Megachile rotundata, 
Megachilidae), which is a solitary nesting bee mainly foraging on alfalfa plants 
(Medicago sativa), and against the alkali bee (Nomia melanderi, Halictidae), which 
is a solitary soil-dwelling bee [47]. Regarding Bombus terrestris, toxicity tests using 
micro-colonies showed that pyriproxyfen (Admiral, 10% EC) did not cause acute/ 
chronic worker mortality by oral/contact exposure. Similarly, no effect on repro- 
duction was reported when B. terrestris workers were exposed for 11 weeks to the 
maximum field-recommended concentration of pyriproxyfen (25 mg a.i. L-!). In con- 
trast, pollen exposure to pyriproxyfen (25 mg L~') resulted in a significantly higher 
number of removed third- and fourth-instar larvae, implying a lethal blockage of the 
development before metamorphosis [48,49]. 

Consequently, it was of primary interest to study the potential adverse effects of 
sublethal concentrations of pyriproxyfen on the main life-history traits of the honey 
bee to see whether this allocation has to be changed or not. To do so, an extensive 
bibliographical investigation was performed to compile all the data on the ecotoxico- 
logical effects of pyriproxyfen on honey bees. It was completed by original ecotoxi- 
cological data obtained in the frame of this study. 


9.2 AGENT-BASED MODEL 


9.2.1 Mopbet DESCRIPTION AND PARAMETER SETTING 


The process of designing an ABM starts with its conceptualization. Basic questions 
and goals, the elements of the system represented by the model environment and the 
different types of agents with their rules, and the measurable outcomes of interest 
have to be identified. It is crucial to establish whether the necessary simplification 
that has always to be made during the design process of a model will not affect the 
credibility and likelihood that the model provides realistic results [50,51]. The next 
step deals with data acquisition that is very often not a straightforward process due 
to the high number of parameter values to be set for designing most of the ABMs. 
This is particularly true for a population dynamics ABM for a honey bee colony. The 
difficulty relies on the scarcity of the biological data that are mostly obtained on dif- 
ferent subspecies, under various environmental conditions, and very often without 
repetitions. Because it is never useful to reinvent the wheel, we always have to take 
advantage of the reflections, strategies, and tricks used by others who have made 
interesting population models on bees or models focused on a specific point of the 
bee life history. Thus, different models have been dissected with precision [42,52— 
55]. Among them, the most exploited was HoPoMo [54], which was first recomputed 
in R and its bugs corrected in order to be used as a benchmark simulator for testing 
the behavior of some parameters. 

Our model, called SimBeeBop (version 1.04), was written in Java. It runs from 
145 parameters including 113 parameters that characterize the structure and the 
properties of the agents and the environment, 27 parameters that allow modula- 
tions of different agent properties, such as the application of "perturbations," and 
5 parameters for optimizing memory allocation. On the basis of a large literature 
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review and the use of trial-and-error procedures for data adjustments, default values 
were proposed. Obviously, they can be changed by the users. 

To be closer to reality, SimBeeBop considers a Dadant hive as the environment 
and all the inhabitants of the hive as agents. The Dadant hive, which is the most used 
in Europe, includes 10 frames (420x 270 mm). The hive body is surmounted by one 
or more supers for storing honey and each comprises nine frames (420x 135 mm). 
The frames in the hive are covered on both sides with hexagonal cells of different 
sizes and functions. The numbers of cells in the hive body and hive super were equal 
to 80,000 and 36,000, respectively [56]. Obviously, these figures can be changed. 
The hive super is only filled with honey. The hive body includes honey, pollen, and 
the brood. The spawning activity of the queen shows large fluctuations [57,58]. Such 
variations are partly due to the brood cells, which are not rapidly available or not 
cleaned enough. The abiotic factors, pollen availability, and the age of the queens are 
other influential factors. The egg-laying dynamics of the queen is rarely taken into 
account in the models inducing a significant bias. Very often, when the queen is taken 
into account, a laying rate of 1 egg min“ is assigned [41,52]. Schmickl and Crailsheim 
[54], in HoPoMo, accounted for a variation in the egg-laying rate, but their model 
being parameterized along 1 year, they did not take into account the decrease in 
performance with age. Conversely, they integrated an individual variability through 
a factor of stochasticity. In SimBeePop, attempts were made to simulate at best the 
reality by accounting for the main factors influencing the egg-laying rate of the 
queen (Figure 9.1) during 2 years or more. Notice that the maximum queen's laying 
rate was equal to 2,000 eggs day! during the summer time [54]. The queen progres- 
sively starts to lay at D+30 and reaches a potential optimal laying activity from 
D+60 to D 150. Then, a decrease in laying activity is observed until D+ 320, when 
the queen stops to lay eggs. This laying cycle is common under our latitudes [58]. 
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FIGURE 9.1 Factors influencing the egg-laying rate of the queen. 
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FIGURE 9.2 Different hive inhabitants. 


It is noteworthy that it is not only the queen that is responsible for the amount of 
brood produced. During certain periods and critical situations in food resources, 
the workers are also critical to regulate brood rearing [58]. Indeed, cannibalism is a 
common mechanism of regulation observed in the first larval stages [59,60]. To our 
knowledge, only Schmickl and Crailsheim [54], in HoPoMo, accounted for the can- 
nibalism phenomenon in the larvae except during their pupal stage. The same strat- 
egy was used in SimBeePop. The five larval stages (L1-L5) for the worker bees and 
the drones (Figure 9.2) were characterized from Rembold et al. [61], Michelette and 
Soares [62], and Lipinski et al. [63]. In colonies of Apis mellifera, drones typically 
compose 5%-10% of the adult population. However, the colony adjusts its invest- 
ment in drones in accordance with biotic and abiotic factors [64]. In SimBeePop, 596 
of the eggs laid by the queen are future drones. 

Honey bee division of labor is characterized by temporal polyethism, in which 
young workers remain within the hive and perform various tasks whereas old work- 
ers perform more risky tasks outside the hive as foragers [65]. In the literature, 
there exists a considerable variability in the ages at which tasks are performed by 
workers. There also exists discrepancy in the number of different tasks performed 
by the bees within the hive [66]. From a modeling point of view, it is not neces- 
sary to consider all the types of tasks that could be observed in a bee population. 
Conversely, it is necessary to introduce a high plasticity between the selected castes. 
Thus, in SimBeePop, four castes were computed, namely, the cleaning bees, the 
nursing bees, the receiving/processing bees, and the foraging bees, with the age 
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FIGURE 9.3 Plasticity applied between castes within the hive. 


limits of 3, 12, and 21 days, respectively [67,68]. The plasticity applied between 
the castes in case of stresses appearing within and/or outside the hive is displayed 
in Figure 9.3. 

To correctly estimate the long-term effects of xenobiotics on honey bees, espe- 
cially when they act at sublethal concentrations on different bee targets, it is neces- 
sary to consider their population dynamics over | year. To do so, the winter bee 
population has to be included in the modeling process. Depending on external and 
internal factors, winter bees can start to appear in July, most frequently in August, 
but they mainly hatch in September [58,69]. The life duration expectancy for a 
winter bee varies from 150 to 200 days with a maximum of 243 days [70,71]. In 
SimBeePop, the queen starts to lay winter bee eggs in mid-August, and hence, the 
first winter bees emerge at the beginning of September (D+250). Their maximum 
life duration is of 180 days. This means that it is possible to find winter bees in the 
hive till the first few days of May. This corresponds to reality [71]. As shown in 
Figure 9.3, the activity of winter bees is rather ubiquitous. Wintering bees play a 
key role at the beginning of the season to restart the colony development. To secure 
an optimal development of the colony during the active season, at least a population 
of 10,000 wintering bees is necessary at the beginning of the year [58]. This is the 
threshold selected by Pratt [53] as a starting value in his dynamic programming 
model, followed by a mid-season peak of 30,000, and back to 10,000 by the fall. 
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According to Imdorf and coworkers [58], a minimum population of 5,000—8,000 
bees has to be guaranteed when wintering. In SimBeePop, a threshold value of 4,000 
was selected for population collapse. 

Foragers supply the colony with nectar and pollen collected at varying distances 
from the hive depending on the availability of the resources and the season. In 
SimBeePop, there are between 196 and 3396 of the foragers that collect the pollen. 
This range depends on the needs of the hive. In fact, the recruitment of pollen forag- 
ers takes into account the needs of the hive and the necessity of maintaining a stock 
for holding 6 days. It was considered that nectar contained 40% sugar, which is the 
percentage found in sunflower plants [72]. The food needs of all the inhabitants of 
the hive were estimated mainly from the data of Rortais et al. [73] supplemented 
by some others coming from various studies [74—78]. Cosmetic adjustments were 
made due to the heterogeneous origin of the data. This was made from the use of the 
invaluable population dynamics data and corresponding curves obtained by Imdorf 
and coworkers [58] for broods and adults of different colonies. It is noteworthy that 
while water is absolutely necessary to the metabolism of the honey bee, to maintain 
the necessary humidity and an appropriate temperature within the hive [68,79,80], 
it was not considered in the current version of SimBeePop. However, this does not 
mean that water cannot be considered as a source of contamination even if it cannot 
be directly quantified. 


9.2.2 Sensitivity ANALYSIS 


Sensitivity analysis relies on the quantification of fluctuations of the outputs of the 
model when applying variations on the input parameter values. It allows assessment 
of the parameter's ability to influence the output of a model. The main goal of a 
sensitivity analysis is the identification of the most influential parameters of a sys- 
tem, as well as the assessment of how the response of a model depends on its input 
parameters. When designing an ABM, it is crucial to perform such an analysis to test 
the robustness, to possibly refine the parameter setting, and to better understand rela- 
tionships that arise from the interactions between the agents. Due to space limitation, 
only some examples are given here. 

Stochasticity is an invaluable asset of ABMs to provide realistic simulations. 
Generally, it consists in applying random variations on a given property of constitu- 
tive elements of the model (i.e., an agent, a group of agents, the environment). In 
SimBeePop, the main factor of stochasticity deals with the laying activity of the 
queen. Briefly, at each step (day) a number of eggs (N,,,(t)) to lay is determined 
according to various factors (Figure 9.1). A random variation is then applied to the 
value of N,,.(t). It is governed by a single parameter that indicates the amplitude 
of variations. Figure 9.4 provides model outputs for 2-year simulations considering 
different levels of stochasticity, from no stochasticity in Figure 9.4a to maximum 
stochasticity in Figure 9.4f (amplitude = 100% of N,..(t)). Stochasticity catalyzes the 
emergence of phenomena from agent interactions. Too little (or no) stochasticity 
leads to a deterministic model (Figure 9.4a and b). Too much stochasticity leads to 
chaotic outputs (Figure 9.4e and f). In SimBeePop, a mid-value of stochasticity was 
selected corresponding to Figure 9.4c. 
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FIGURE 9.4 Sensitivity analysis (50 simulation trials) of the stochasticity applied to the 


number of eggs (N,,.(t)) laid by the queen: (a) no stochasticity, (b) 12.5% of N,..(t), (c) 2596 of 
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Nursing requirement corresponds to the number of nurse bees that are necessary 
to feed the brood. Reference values for this parameter were proposed by Schmickl 
and Crailsheim [54] in their HoPoMo model, for the different larval stages. Figure 9.5 
shows the outputs obtained for different values of nursing requirement, including the 
values from HoPoMo (Figure 9.5c), from no nursing requirement (Figure 9.5a) to a 
high nursing requirement (Figure 9.5f). When nursing demand is neutralized (Figure 
9.5a), the feedback of nursing quality on egg laying and on cannibalism is null, 
explaining the different shapes of the curves obtained for the population dynam- 
ics. Increasing the demand in nurses activates polyethism interactions described in 
Figure 9.3, thus increasing cannibalism activity and lowering egg laying if neces- 
sary. If the nurse requirement is too high, bee population dynamics is drastically 
perturbed (Figure 9.5d through f), up to the collapse of the colony. In SimBeePop, 
values proposed by HoPoMo were kept as standard values (Figure 9.5c). 

Cannibalism plays a crucial role in bee population dynamics, as it is a response 
to various stresses (e.g., lack of nurses, lack of pollen). To our knowledge, HoPoMo 
[54] was the first model that includes cannibalism in the modeling process of a bee 
population. This aspect was characterized by parameters denoting the maximum 
proportions of larval population that can be eaten in case of maximum stress. In 
SimBeePop, cannibalism was implemented in a similar way. Different levels of can- 
nibalism were investigated, including values from HoPoMo. Results are presented in 
Figure 9.6. When cannibalism is turned off (Figure 9.6a) or low (Figure 9.6b), output 
uncertainty seems to be higher than for mid-range cannibalism (Figure 9.6c and d). 
This is probably because, with a low level of cannibalism, stress response is less effi- 
cient. On the contrary, too high levels of cannibalism lead to important perturbations 
in population dynamics and possibly to its extinction (Figure 9.6f). In SimBeePop, 
the values from Figure 9.6c were selected as standard values for cannibalism. 

The aforementioned three examples illustrate how sensitivity analyses helped us 
validate as well as find suitable values for the different parameters of SimBeePop 
and better understand the relationships between inputs and outputs. 


9.3 PHYSICOCHEMICAL PROPERTIES AND 
ENVIRONMENTAL FATE OF PYRIPROXYFEN 


At 25°C and pH=6, the solubility in water of pyriproxyfen (99.4%) is only equal 
to 0.367+0.004 mg L~!, while the value of its 1-octanol/water partition coefficient 
(log K.) is 5.37 at 25°C and pH=5.6. With a vapor pressure «1.33x 10^? Pa at 
22.8°C, technical pyriproxyfen (100%) shows a low affinity for the air compartment 
[81]. Pyriproxyfen presents a strong propensity to adsorb onto sediments and soils. 
Adsorption coefficient (K.a) values of 4,980, 11,000, 11,600, 12,600, 26,900, and 
34,200 were found in lake sediment, clay loam, sand, sandy loam, silt loam, and 
silty clay loam soils, respectively [82]. Hydrolysis half-lives are ranged from about 
148 to 605 days at pH=5, 241-1,293 days at pH=7, and 161—511 days at pH=9 [79]. 
Radiolabeled pyriproxyfen subjected to artificial sunlight, approximately equivalent 
to double the light intensity of natural midday sunlight at 43? N in July, in aque- 
ous buffer solution at pH=7 and 25°C for 30 days, led to a rapid photodegradation 
with half-lives of 3.7 days for the [Pyr-'*C]-label and 6.4 days for the [Phe-'*C]-label 
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FIGURE 9.5 Sensitivity analysis (50 simulation trials) of nursing requirement based on 


values of reference from HoPoMo [54]: (a) no nurse is required, (b) half values of reference, 


(c) values of reference, (d) 1.5 times the values of reference, (e) twice the values of reference, 


and (f) 2.5 times the values of reference. 
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ues of reference, (d) 1.5 times the values of reference, (e) twice the values of reference, and 


of reference from HoPoMo [54]: (a) no cannibalism, (b) half values of reference, (c) val- 
(f) 5 times the values of reference. 


FIGURE 9.6 Sensitivity analysis (50 simulation trials) of cannibalism level based on values 
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[81,82]. In natural sunlight and sandy loam soil, [Pyr-'^C]- and [Phe-'*C]-labeled 
pyriproxyfen degraded with half-lives of 10.3 and 12.5 weeks, respectively. In silty 
loam soil, the half-lives were equal to 21 and 18 weeks, respectively [82]. Field studies 
conducted in California on a loamy sand soil to evaluate the mobility and persistence 
of pyriproxyfen when applied to bare ground showed that 4-(4’-hydroxyphenoxy) 
phenyl (RS)-2-(2-pyridyloxy)-propyl ether (4-OH-Pyr) and 2-(2-pyridyloxy)propi- 
onic acid (PYPAC), the major degradation metabolites of pyriproxyfen, were found 
to be stable in soil for up to a year. The greatest pyriproxyfen concentrations were 
found in the 0—6 in. soil layer. No pyriproxyfen residues were found above the level 
of quantitation below 12 in. The half-life of pyriproxyfen in the 0—6 in. soil-layer was 
36 days. No 4'-OH-Pyr or PYPAC residues were found below 2 in. or greater than 
120 days [82]. 


9.4 USE OF PYRIPROXYFEN AND RESIDUES FOUND 
IN ENVIRONMENTAL COMPARTMENTS 


9.4.1 AGRICULTURE 


In agriculture, pyriproxyfen has been the most widely used insecticide to control 
the red scale (Aonidiella aurantii), a major pest in citrus groves worldwide [82,83]. 
Thus, for example, Cunha et al. [84] mentioned that Spain was the sixth major pro- 
ducer in the world with 6.3 million tons produced in 2009 from 318,385 ha. These 
authors sampled about 18,000 ha predominantly planted with oranges (71.2%), tan- 
gerines (26.1%), and lemons (2.7%). Interviews showed that farms between 1 and 
10 ha area prevailed. Air-blast sprayers were the most common machines employed 
(58%) in foliar applications, followed by hand-held gun hydraulic sprayers (42%). 
Typically, operational characteristics of applications with air-blast sprayers in the 
citrus regions of Spain were spray volumes of 1,000-2,400 L ha^! (25th—75th per- 
centiles) on oranges and tangerines and 1,000 L ha^! on lemons. [84]. Interestingly, 
Cunha et al. [84] tried to assess the risk of spray drift on the honey bee. Using a spray 
volume of 4,016 L ha^! (90th percentile extrapolated from questionnaires), giving an 
applied dose of 0.301 kg a.s. ha^! year", a predicted drift at 3 m, and an LD, of 74 ug 
a.s. bee™!, they concluded to an absence of risk to bees. However, it is noteworthy that 
the authors only considered an acute toxicity effect. In addition, the intensity of the 
spray drift depends on numerous conditions including the properties of the sprayed 
products, the characteristics of the culture, the machinery setup, and the meteo- 
rological conditions [85,86]. Thus, for example, to account for all the parameters 
possibly impacting the spray drifts, the technical document on Admiral? Pro [87], 
which is used to fight the San Jose scale (Diaspidiotus perniciosus), the white peach 
scale (Pseudaulacaspis pentagona), or the olive soft scale (Saissetia oleae), indicates 
that the insecticide (0.3 L ha^!) must not be used if mulberry trees that are used as 
food for silkworms are located at less than 2 km of the applied dose. The number 
of available studies on the levels of residues found in citrus groves after the applica- 
tion of pyriproxyfen is rather limited. Orange groves in different sites in California, 
Florida, and Texas were treated at intervals of 20—22 days with pyriproxyfen using 
airblast sprayers [88]. Freezer storage periods ranging from 3 to 95 days were applied 
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prior to analysis. Where 0.12 kg a.i. ha“! was applied, residues ranging from 0.09 to 
0.23 mg kg"! were found in fruits. In some trials where measurements were made 
at t+21, no significant decrease in the concentrations was noted. Where 0.25 kg a.i. 
ha^! was applied, the residues of pyriproxyfen were 0.41 mg kg" in the fruit and 
0.01 mg kg" in the edible portion, giving a factor of 0.024 for the “process” of peel- 
ing oranges [88]. Hattingh and Tate [89] and Hattingh [83] showed that pyriproxy- 
fen residues on citrus leaves still induced 100% sterility in coccinellid Chilocorus 
nigritus after 20 weeks of field weathering. The same conclusions were obtained by 
Smith et al. [90]. More generally, the average (and maximum) concentrations in pg 
kg"! of pyriproxyfen in strawberries, tomatoes, plums, green beans, almonds, apples, 
peaches, and cherries were found to be 0.2 (74), 0.2 (20), 0.08 (20), 0.06 (13), 0.04 
(8.1), 0.03 (22), 0.02 (13), and 0.006 (2.4), respectively [91]. 

Pyriproxyfen has been also used for controlling the Homoptera Bemisia tabaci 
biotype B (B. argentifolii), a key pest of cotton and other vegetable crops worldwide. 
On cotton, Naranjo et al. [92] used aerial and ground applications of 60 g pyriproxy- 
fen ha^. Pyriproxyfen is also used against the mulberry scale (Pseudaulacaspis 
pentagona), which is harmful to tea and difficult to control, because the insect 
produces 3—4 generations year-!, parasitizing and sucking on the branches of tea 
plants. Isayama and Tsuda [93] showed that a high residual activity against mul- 
berry scale continued 100—150 days after a treatment of pyriproxyfen at 90 ppm. 
Pyriproxyfen is one of several insecticides being used in California for the control 
of the red imported fire ant (Solenopsis invicta), a major agricultural, horticultural, 
and urban pest [94]. 


9.4.2 Vector CONTROL 


Pyriproxyfen is also used in vector control. WHO [95] has assessed pyriproxyfen 
for use as a mosquito larvicide in drinking water in containers, especially for the 
control of dengue fever. The recommended dosage of pyriproxyfen in potable 
water in containers should not exceed 0.01 mg L-! under the WHO Pesticides 
Evaluation Scheme [96,97]. For the control of Aedes albopictus, responsible 
for the Chikungunya epidemic on Réunion Island in 2005-2006, pyriproxyfen 
(Sumilarv® 0.5%, granule formulation) at the rate of 5-10 g a.s. ha^! was recom- 
mended. Doses until 100 g ha^! were suggested for highly contaminated zones. It 
was considered that a treatment remained active for 6 weeks, and two consecu- 
tive treatments were necessary to secure a maximum of efficacy in the control of 
the mosquitoes [46]. The same formulation applied at the rate of 0.01 mg a.i. L^! 
to gem pits and river bed pools in a gem mining area in Sri Lanka inhibited the 
emergence of Anopheles culicifacies adults for 185 and 190 days, respectively, 
reducing significantly the incidence of malaria [98]. The granular formulation of 
0.596 pyriproxyfen was evaluated for the inhibition of emergence of Aedes togoi 
in brackish water of rock pools near a coastal area in Pusan, South Korea [99]. 
Over 90% inhibition of emergence was observed 70 days after treatment at 0.1 
and 0.05 mg L~. A concentration of 0.01 mg pyriproxyfen L~! leads to about 60% 
inhibition of emergence 70 days posttreatment. 
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9.4.3 VETERINARY MEDICINE 


Pyriproxyfen is marketed as a spot-on topical treatment for prophylactic flea control 
on cats and dogs, generally in combination with other biocides [100—102]. It has 
been also reported that pyriproxyfen kills adult fleas when applied in relatively high 
dosages via dog hair or when administered in the blood diet [101]. The residues that 
could be found in the environment resulting from this use are not documented and 
difficult to assess. 


9.5 EFFECTS OF PYRIPROXYFEN ON HONEY BEES 


In Apis mellifera, the process of cuticular melanization starts at the pupal stage. 
Bitondi et al. [103] showed that bees treated during their different developmental 
phases with pyriproxyfen showed important alterations in cuticular pigmentation 
and sclerotization. 

Fifth-instar larvae at the feeding phase (LF5, 4—4.5 days after hatching) were 
topically treated with 1 ug pyriproxyfen dissolved in 1 pL acetone in their own 
comb cells. Controls were treated with 1 uL acetone or left untreated. Three areas 
of a comb containing larvae of the same age were delimited for juvenoid or acetone 
treatment and for controls, respectively. After treatment, the combs were returned 
to the hives. Interestingly, the authors noted that larvae treated with pyriproxyfen 
and subsequently reintroduced into the colonies were preferentially removed from 
their cells by the workers. However, this event was not quantified. At the beginning 
of the pupal period (about 8.5—9 days a.h.), pupae were removed from the combs and 
placed in an incubator at 34°C and 80% relative humidity in order to control their 
emergence [103]. 

Fifth-instar larvae at the spinning phase (LS5, 5-6 days a.h), prepupal 
(PP, 7-8 days a.h) and pupal stages, white-eyed, unpigmented cuticle pupae 
(Pw, 8.5—9 days a.h.), pink-eyed, unpigmented cuticle pupae (Pp, 10 days a.h.), dark- 
pink-eyed, unpigmented cuticle pupae (Pdp, 11 days a.h.), and brown-eyed, unpig- 
mented cuticle pupae (Pb, 12—13 days a.h.) were collected from the hives and treated 
with 1 ug pyriproxyfen. Pw pupae were also treated with other concentrations of 
pyriproxyfen (0.1 and 5 pg pL! acetone). Controls were treated with 1 pL acetone 
or left untreated. The bees were not returned to the hives but were maintained in an 
incubator at 34°C and 80% relative humidity [103]. 

When the treatment at 1 ug was applied during LF5, the pupal development was 
blocked, and pigmentation did not occur. Treatment of older larvae (LS5, PP, Pw) did 
not impair pigmentation, but, conversely, this process was accelerated, intensified, 
and abnormal. Juvenoid treatment during these developmental phases (LS5, PP, and 
Pw) induced earlier activity of phenoloxidase, an enzyme of the reaction chain lead- 
ing to melanin synthesis. When pyriproxyfen at 1 ug was applied to Pp, Pdp, or Pb 
pupae, developmental periods during which the cuticle is no longer affected, the juve- 
nile hormone analogue promoted an acceleration in pupal development and, hence, 
a precocious emergence. The authors [103] showed that treated pupae presented sig- 
nificantly higher enzymatic levels and a graded response in phenoloxidase activity 


194 In Silico Bees 


after treatment with 0.1, 1, or 5 ug of pyriproxyfen. These results were consolidated 
in another study [104], in which they also showed that the topical application of 
pyriproxyfen (1 pug L~’) led to a delay of the pupal ecdysteroid peak by nearly 
4 days. Santos et al. [105] demonstrated that the topical application of pyriproxyfen 
(1 pg L~’) to Pw bees accelerated the typical protein pattern from one phase to the 
next. The protein pattern observed 96 h after treatment was similar to that observed 
much later in controls (i.e., 192 h). On the contrary, 20-hydroxyecdysone induced an 
arrest in the protein pattern development. A double hormonal treatment restored the 
normal temporal expression of epidermal proteins. 

Pinto et al. [106] showed that pyriproxyfen affected the synthesis, secretion, and 
accumulation of vitellogenin in a dose-dependent fashion in young honey bee work- 
ers, Africanized Apis mellifera. Groups of 120 newly emerged bees were treated 
with 1 uL acetone containing different concentrations of pyriproxyfen (10, 5, 2.5, 
1.25, 0.1, 0.01, or 0.001 ug). The control group received 1 uL acetone only. They were 
confined to small cages and placed in an incubator for 6 days. Because vitellogenin 
synthesis depends on pollen consumption, access to this resource as well as to water 
was guaranteed to all workers. Three hours after treatment (day 0) and every 24 h 
until the 6th day, hemolymph was extracted through a small superficial incision in 
the abdominal dorsal cuticle of the insect. Samples from 20 workers of the same age 
and cage cohort were pooled. Vitellogenin concentration in hemolymph was mea- 
sured by rocket immunoelectrophoresis. In the controls, an increase in vitellogenin 
titer from day 4 to day 6 of adult life was observed. Pyriproxyfen inhibited this effect 
when topically applied at 10 ug to newly emerged workers. Consequently, the vitel- 
logenin concentrations in 4—6-day-old treated bees were extremely low, comparable 
to those of 0—3-day-old bees. 

The lack of vitellogenin accumulation in treated bees was reflected in the total 
protein content of the hemolymph. Protein dosage by the dye-binding assay showed 
that, by day 6, bees treated with 10 ug pyriproxyfen presented significantly lower 
protein titer than controls of the same age. The dose-dependent inhibitory effect of 
pyriproxyfen was evident in 6-day-old workers. After application of 1.25 to 10 pg 
of pyriproxyfen, protein titers decreased progressively. Treatment with doses of 0.1, 
0.01, or 0.001 ug of pyriproxyfen did not affect the normal accumulation of pro- 
tein in hemolymph [106]. The low vitellogenin titer in the hemolymph of pyriproxy- 
fen-treated bees was not due to its enhanced sequestration by ovaries. None of the 
pyriproxyfen-treated bees had vitellogenic ovaries, as shown by ovary examination 
after dissecting bees under a stereomicroscope. In a complementary study, fat bod- 
les attached to abdominal cuticles were dissected from confined 6-day-old workers 
treated with 0.01 or 10 ug pyriproxyfen or acetone (controls) at emergence. In each 
assay, two fat bodies were cultured in vitro (34?C for 24 h). Results showed that fat 
bodies obtained from bees treated with pyriproxyfen synthesized and secreted less 
V, in vitro than untreated controls [106]. 

The aim of the aforementioned studies is mainly to better understand the physi- 
ology and the developmental mechanisms of the honey bee rather than to estimate 
the adverse effects of pyriproxyfen on this beneficial insect. Pyriproxyfen is used in 
place of the juvenile hormone at concentrations that are very often higher than those 
belonging to the sublethal domain. 
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Machado Baptista and coworkers [107] showed that the direct spraying of 
pyriproxyfen (Cordial 100 EC— 20.075) on bees led to a TL. of 466 h. Utsumi et al. 
[108] at Sumitomo Chemical Co. Ltd. (Japan) tested the potential adverse effects of 
pyriproxyfen (1096 EC) on honey bees under field conditions. Four colonies includ- 
ing 60,000—80,000 workers were used per group. Each group was placed within 
0.5 ha located at 3 km from full-flowering Phacelia tanacetifolia. A treatment of 75 
g a.s. ha! was applied. Both the eggs and larvae in the combs developed into healthy 
adult bees and no differences were found with the controls. The number of dead bees 
from the colony after treatment, obtained by continuous monitoring of the traps, was 
lower than that observed during the acclimation period of the hives and was the same 
as for the untreated colonies [108]. On the other hand, Yang et al. [109] stressed a 
significant impact on the honey bee brood. One-day-old larvae were reared in the 
laboratory and fed with 0, 0.1, 1, 10, and 100 ppm of pyriproxyfen in larval food. 
A dose-response effect was found in the larval development of the treated larvae. 
At 0.1 ppm, 58.996 of the larvae succeeded to pupation, and 52.696 of adult emer- 
gence was obtained. Among these adults, 2.896 showed deformed wings. At 1 ppm, 
only 15.5% of emergence was obtained and 13.1% of the bees presented deformed 
wings. At 10 and 100 ppm, all the honey bees died before emergence. 

In the frame of a research program aiming at estimating the endocrine disruption 
potential of xenobiotics on the honey bee [110], the potential adverse effects of 
sublethal concentrations of pyriproxyfen on the larval developments of bees were 
thoroughly investigated by means of a larval test developed by Aupinel and cowork- 
ers [111-113]. The principles of this test are summarized in Figure 9.7. Briefly, 
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first-instar larvae are produced at the apiary. Queens of experimental healthy 
colonies are confined on empty combs where they lay eggs. One day later, they are 
removed and the combs with eggs are returned to the colonies for incubation. Three 
days later, frames with first-instar larvae (L1) are removed. In the laboratory, larvae 
are transferred into culture plates with artificial rearing cells. They are reared in an 
incubator at 35°C. The contamination via the larval diet is made at D+ 1 and D+3 to 
D+6. During pupation stage (D+ 15), the plates are placed in boxes for adult emer- 
gence. This test is particularly interesting because it allows us to take into account 
many factors throughout the larval development of the bee. It offers the opportunity 
to assess the effects of a chronic exposure to a molecule during the larval stage at the 
individual and population level. Two different types of experiments were performed. 

To estimate the delayed effects on nymphs and adults of a chronic exposure, 
attempts were made to measure the development of hypopharyngeal glands in the 
bees after emergence. Hypopharyngeal glands are the main organs responsible for 
the royal jelly secretion by the nurses [114,115]. Their size is age and food protein 
dependent and it is correlated to the amount of secretion as well as the weight of the 
head. Their development can be assessed by measuring the total protein contents 
of the glands from the Bradford method after their extraction [116]. Thus, the bees 
emerging from the larval test were reared in the laboratory until the age of 10 days. 
During this period, they were fed ad libitum with pollen and syrup. At D -- 26, the 
bees were sacrificed and the protein contents of their hypopharyngeal glands were 
measured by the Bradford method. Thus, we showed [110] that 305 ppb of pyriproxy- 
fen, corresponding to a cumulative dose of 54 ng larva'!, significantly reduced the 
protein contents in the hypopharyngeal glands. Consequently, we deduced that this 
concentration highly perturbed the activity of the nurses within the hive. 

In another series of experiments, the larval test was performed with concentra- 
tions of 101 ppb (18 ng larva!) and 305 ppb (54 ng larva!) of pyriproxyfen. Water 
and acetone were used as controls. The cumulative larval (D 7), pupal (D 4 15), and 
adult mortalities at the end of the emergence period (D +20) were not significantly 
different. In contrast, exposed individuals presented shorter development time; these 
individuals emerged earlier than control groups. At emergence, bees showed mal- 
formations, mainly atrophied or damaged wings. The malformation rate was sig- 
nificantly different between controls and the highest contaminated dose. At 54 ng 
larva-!, 20% of emerging bees were malformed versus less than 6% for the controls. 
In another series of experiments, 3596 of malformations were obtained, but the con- 
trols included 1646 of malformed. Conversely, no significant difference was observed 
between the controls and bees treated with pyriproxyfen at 101 ppb. 

The normal emerging adults of each day were collected and labeled with colored 
and numbered tags. They were then released into a hive of observation (including 
glass sides with a grid) containing a receiving colony, which consisted of four frames 
(two frames of brood of all ages, one frame of honey and pollen, one empty frame 
for storing reserves). This colony was placed outside under natural semicontrolled 
conditions. Observations were performed every day over 16 days. Dead bees were 
counted, and behaviors were recorded from an ethogram with the scan technique 
from Kolmes, which consists of drawing a grid on the glass walls of the hive and 
recording the behavior of the first bee present in every square observed. Analysis 
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was made by grouping behaviors into two categories, namely, the social (e.g., brood 
care, congeners care) and nonsocial (inactivity, groom self) behaviors. Bees exposed 
to the two pyriproxyfen concentrations showed significantly fewer behaviors related 
to the social cohesion of the colony than the controls, especially those dealing with 
brood care. However, the most interesting behavior was the rejection of the emergent 
bees by their congeners following their introduction in the hive. This was recorded 
by counting the number of dead bees in front of the hive entrance. In a first trial, 
the concentrations of 101 and 305 ppb of pyriproxyfen led to about 38% and 80% 
of rejections, respectively. Less than 1096 of rejection was recorded for the controls 
[117]. In another trial, the concentrations of 101 and 305 ppb of pyriproxyfen led to 
about 18% and 36% of rejection, respectively. Both controls only led to 6% of rejec- 
tion [118]. 

Last, it is worth noting that while numerous pesticides can accumulate in hive 
products [119—122], pyriproxyfen was only found in wax at a maximum concentra- 
tion of 8 ppb [119,120]. 


9.6 SIMULATION OF LONG-TERM EFFECTS 
OF PYRIPROXYFEN ON HONEY BEE POPULATIONS 


Honey bees commonly forage within 1.5 km of their hive and exceptionally as far as 
10—12 km, depending on their need for food and its availability. During their forag- 
ing flights, they visit numerous plants to gather nectar, pollen, honeydew, sap, and 
water [123]. Foragers also visit puddles, ponds, and other aquatic resources to collect 
the 10—40 L of water that are necessary annually for the colony [124,125]. Thus, the 
honey bees can be contaminated by pyriproxyfen used in agriculture and when it is 
applied as larvicide in vector control. The transfer of pyriproxyfen by Aedes albop- 
ictus and Aedes aegypti and subsequent inhibition of emergence of the mosquitoes 
have been recently demonstrated [126,127]. This kind of contamination is even more 
possible with the honey bee, due to the quantity of contaminated water that would be 
transferred within the hive and also because it is well known that a part of the water 
is brought back directly into the brood cells to guarantee the 90%—95% relative 
humidity necessary for the complete hatching of the eggs [128]. 

Our experiments and those by others show that sublethal concentrations of pyri- 
proxyfen affect the development of honey bees and disturb the normal behavior of 
the colony. Inspection of the literature reveals that these effective concentrations are 
in the ranges of the residual concentrations found in the aquatic and terrestrial envi- 
ronments when pyriproxyfen is used in vector control and in agriculture. In addition, 
the persistence of pyriproxyfen in these media can be of few months. 

Various scenarios were elaborated to fully estimate the long-term effects of sub- 
lethal concentrations of pyriproxyfen on a honey bee population. Thus, for example, 
Figure 9.8a shows the evolution of the different hive inhabitants during a 2-year 
period after a perturbation consisting in the rejection of 5096 of the emergent bees 
by their congeners for 2 months from June 1. A linear decreasing effect was applied. 
In practice, this means that after 1 month, the rate of rejection was only 25%. This 
scenario is totally realistic. The inspection of Figure 9.8a, which is the mean of 
50 simulation trials, shows that the normal dynamics is rather rapidly restored, the 
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FIGURE 9.8 Evolution of the different hive inhabitants during a 2-year period after a per- 
turbation consisting in (a) a rejection of 5096 of the emergent bees by their congeners, (b) a 
significant impact on the efficacy of the nurses, and (c) both effects jointly during a 2-month 
period, starting on June 1 and with a linear decreasing effect. 
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population of the second year growing satisfactorily. In Figure 9.8b, the efficacy of 
the nurses was perturbed. The perturbation started on June 1 and was applied for 
2 months with a linear decreasing effect. This scenario is also realistic because we 
showed that pyriproxyfen affected the hypopharyngeal glands of the nurses at sub- 
lethal concentrations. Figure 9.8b displays the result of 50 simulation trials. Again, 
the population was affected during the stress period but not enough to impact the 
dynamics of the population during the second year. Interestingly, Figure 9.8c shows 
the effects of both perturbations on the bee population dynamics. Fifty simulation 
trials were performed. When the two types of adverse effects are applied jointly, a 
definitive collapse is observed at the end of the first year. This clearly illustrates the 
interest of a population dynamics model, and especially an ABM, to study the long- 
term effects of ecotoxicological events observed at different levels of organizations 
in a complex system. 

In another series of simulations, an attempt was made to test the effects of the 
date of application of the perturbation. Thus, in Figure 9.9, the evolution of the dif- 
ferent hive inhabitants during a 2-year period after a perturbation consisting in a 
rejection of 30% of the emergent bees by their congeners and a significant impact 
on the efficacy of the nurses during a 2-month period with a linear decreasing effect 
was tested with the perturbation starting always on March 1 (a), April 1 (b), May 1 
(c), June 1 (d), July 1 (e), or August 1 (f). Each time, 50 simulation trials were per- 
formed. Figure 9.9a shows that the perturbation is applied too early in the season, 
and, hence, most of the time, in the second year, the bee populations are highly 
perturbed. Such colonies will collapse sooner or later. In other trials, the colonies 
seem to be less affected in the second year, except as regards the number of indi- 
viduals, which is lower than in a normal population. This difference of population 
dynamics, clearly shown from the ABM simulation results, corresponds to what is 
observed in practice. Indeed, it is well known that the different colonies within an 
apiary do not behave similarly when faced with an external stress. When the pertur- 
bation is applied on April 1 (Figure 9.9b) or May 1 (Figure 9.9c), many more popu- 
lations present a normal development during the second year, except their size, but 
some of them remain perturbed. This phenomenon is even more accented when the 
perturbation is applied on June 1 (Figure 9.9d). Conversely, when the perturbation 
is applied on July 1 (Figure 9.9e), the populations will be strongly affected in the 
second year, leading very often to collapses. In all cases, with a maximum of about 
20,000 adult bees, there is no doubt that a colony will not survive durably. When 
the perturbation is applied on August 1, a total collapse is observed at the end of the 
first year (Figure 9.9f). These different simulation results (Figure 9.9) are particu- 
larly interesting. They show that there exist critical periods during which the bee 
populations are more sensitive against stresses. Broadly speaking, they correspond 
to the beginning of the season when the colony starts its development. The strength 
of the bee colony must be enough to support a perturbation, otherwise its normal 
and durable development cannot be expected. The period during which the winter 
bees are produced corresponds to the second critical phase, which can lead to a 
total collapse of the colony. More generally, Figure 9.9 clearly illustrates the inter- 
est of an ABM, which tends to copy at best reality due to its inherent stochasticity. 
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9.7 CONCLUSIONS 


Even if pyriproxyfen is currently classified as moderately or not toxic to honey bees 
on the basis of acute toxicity tests, recent experimental studies reveal that exposure 
to low doses of this juvenoid during larval stages can cause adverse effects at the 
colony level. This is clearly shown when our original ABM, called SimBeePop (ver- 
sion 1.04), is used to simulate the bee population dynamics during a 2-year period, 
following different realistic contamination scenarios. 

From an ecotoxicological point of view, our study shows that the current regula- 
tory tests are not suited to detect the potential adverse effects of chemicals on the 
endocrine system and development of honey bees. The forthcoming inclusion of the 
larval test in the battery of tests to perform on bees is welcomed to start to fill this 
gap in the regulation of insecticides. 

From a modeling standpoint, our study also demonstrates the invaluable role of 
the population dynamics models to fully exploit the various results obtained with 
in vivo and in vitro experiments. Indeed, the complexity of the relationships between 
the adverse effects of a chemical observed at the individual level and the subse- 
quent possible impacts at the population level makes necessary the use of modeling 
approaches to test various scenarios with the goal of better understanding and, if 
possible, simulating the toxicity of the chemicals. 
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ABSTRACT 


Bees are important pollinators, but both honey bees and wild bees are rapidly declin- 
ing. One of the drivers for the decline of wild bees is land-use change, which affects 
the field mosaic and the fragmentation of the landscape. There is no general consensus 
in the literature about how wild bees respond to landscape configuration. Up to now, 
there are no simulation models that compare the performances of different solitary 
bees at the landscape scale. Body-size-related traits affect individual foraging behavior. 
We have therefore developed a spatially explicit individual-based simulation model, 
SOLBEE, with different bee traits and behavioral rules, which mimics the behavior 
and movement of pollen-collecting solitary bees. The model landscape is a square kilo- 
meter in size and consists of many patches with foraging habitat (varying amount) 
separated by inhospitable matrix (varying fragmentation levels). The foraging habitat 
has patch attributes such as flower density and minimum patch size. The bees differ in 
size (and in derived foraging traits such as velocity), nesting preference, and nest loca- 
tion. The system is further characterized by a timeframe of a single foraging day (with 
time steps of 1 s) in which bees forage and compete with each other for pollen. Bee 
numbers (and density within the landscape) are scaled with present foraging resources 
and body size. During the day, these central-place foragers displace pollen from flow- 
ers (distributed over a mosaic of patches) to their nest. The main goal is to compare 
how bees perform in terms of fitness (brood cells) and pollination services (number 
of flowers visited, foraging habitat visitation, and foraging distance) within a foraging 
day. Parameterization of the model input is mainly based on literature review, and the 
model’s rule behavior was improved with a pattern-oriented approach. 

In several examples, we present four simulation experiments to investigate 
parameter effects and parameter sensitivity (Section 10.4). We show that the model 
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produces realistic foraging behavior progressively during the foraging day and that 
the responses overlap well with values from the literature. This can be considered 
as a validation with the exception that model bees were found to be somewhat more 
efficient than real bees, yielding higher numbers of brood cells. A global sensitiv- 
ity analysis of the parameters in their biological range revealed that the amount of 
pollen per flower (i.e., flower size) most influenced the number of brood cells and 
foraging habitat visitation. Body size was the dominant parameter for the number of 
visited flowers and the mean flown distance. The remaining two simulation experi- 
ments showed that the model can be considered robust against small changes (1096 
change in parameter value). The parameters that affected the responses here most 
were handling time per flower from the bee-related parameters and the amount 
of pollen per flower and pollen limitation (dispensing mechanism of the flower) 
from the landscape-related parameters. The simulation experiments yielded basic 
understanding of the model. Time constraints are more important for solitary bees 
than foraging resources, as they affect wood-nesting bees, which nest at field edges, 
more than soil-nesting bees. 


KEYWORDS 


Individual-based model (IBM), Solitary bees, Pollen foraging, Resource competition, 
Body size 


10.1 INTRODUCTION 


The honey bee (Apis mellifera) is the single-most important pollinator in the world [1]. 
However, the world counts about 20,000 wild bee species that are good pollinators as 
well [2]. Solitary bees are the largest subgroup of wild bees with about 14,000 species 
worldwide [3]. They live solitary and have a wide range of different food preferences, 
nest preferences, and behavioral traits (Figure 10.1). They differ considerably from 
eusocial and semisocial bees in foraging behavior (see, e.g., [4-6]). Communication 
between eusocial bees can lead to near-optimal foraging [7,8], while solitary bees do 
not communicate about foraging patches. Solitary bees forage alone and therefore 
deal with limited knowledge of resource locations and their quality. While eusocial 
bees spend a large part of their time foraging for nectar, solitary bees focus on the 
collection of pollen for their offspring [9]. Evidently, “bee,” “honey bee,” “flower 
visitor,” and “pollinator” cannot be used as synonyms [10]. 

Pollination is essential for many wild plants and human food crops. The rapid 
worldwide decline of honey bees and wild bees [11,12] has alarmed conservationists 
and politicians to take action to reduce pollinator losses [13]. The 2010 target to 
reduce the rate of biodiversity loss has not been met, despite increasing political 
effort to protect biodiversity [14]. The contribution of honey bees to crop pollina- 
tion may have been overestimated [15,16], and protecting natural habitat near crop 
fields seems to be a key solution in providing natural pollination services (see, e.g., 
[16-19]). In agricultural areas, habitat management for maintaining wild pollinator 
populations in the landscape can be a cost-effective way of securing crop pollination, 
especially when honey bees are decreasing [20]. 
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(a) (b) 


(9) (d) 


FIGURE 10.1 Solitary bees are a large group of pollinators with different traits including 
body size and nesting preference. They share the same foraging resources. (a) A small soil- 
nesting solitary bee. (b) An intermediate-sized wood-nesting solitary bee. (c) A small solitary 
bee foraging for nectar and pollen on Campanula patula. (d) An intermediate-sized solitary 
bee foraging for nectar and pollen on Campanula patula. (Photo by J. Everaars.) 


Agriculture is probably the largest threat for wild bees. Increased land use for 
agriculture leads to habitat fragmentation and loss of bee habitats and seems to be 
the most important driver of wild pollinator losses [21,22]. There is a consensus 
on how honey bee colony losses can be reduced [23,24], but defining how agri- 
culturally dominated landscapes can be optimized for wild bees is more complex 
[18]. Many authors underline the need for a better mechanistic understanding of 
the effect of landscape configuration on wild bees in order to estimate the impor- 
tance of habitat loss and fragmentation, to estimate the effects of land use on 
pollination services, and to support management decisions [12,25—29]. Body size 
and nesting preference affect the response to landscape features and fragmenta- 
tion, but, up to now, no systematic exploration exists. Body size (comprising a 
wide range in solitary bees) affects traits such as the bee's velocity or capacity 
for carrying pollen (Figure 10.2). These traits influence the response of bees to 
landscape structures [30]. Models can help understanding how bees perform in 
patchy landscapes. 
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FIGURE 10.2 Effect of body size on different traits that affect the foraging behavior of 
solitary bees. Equations and references are given in Table 10.3. 


Existing models with pollinators are of limited value for understanding the inter- 
action between solitary bees and landscape structure. Data-based approaches include 
only little biological detail (see, e.g., [31,32]). A few recent models included more 
biological realism. One model considered solitary foragers with limited memory 
rather than communicating eusocial bees [33]. Another study estimated field-to-field 
gene flow of crops by moving bumblebees based on experimental data [34]. A rela- 
tively detailed model did include local resource competition in space, bee size, and 
spatial configuration of patches, but focused on eusocial honey bees only [35]. 

No model has yet considered active pollen foraging as the main driver of pollina- 
tor movement. The existing models additionally lack several of the following com- 
ponents: comparison between different pollinators, partial habitats for nesting and 
foraging, differentiation between individuals, local competition, and size of the polli- 
nator. Solitary bees are mainly foraging for pollen to provide their brood cells. Pollen 
differs from nectar in the sense that it does not replenish during the day. Solitary bees 
fly out alone from the nest, forage at the closest suitable flower patch, and return 
when they collect enough pollen and/or nectar. This typical behavior of solitary bees, 
which differs from eusocial bees, was the reason to develop a new model. 

We developed a model with biological detail to study the interaction of wild bees 
with the landscape. We decided to use an individual-based, spatially explicit simula- 
tion model to simulate naive solitary bees that forage for pollen in the landscape. 
Time could be more constraining than energy for wild bees [36], and we therefore 
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focused on differences in daily performance. The individual-based model (IBM, or 
agent-based model, ABM) is an established method for investigating animals in space 
and time, including solitary bees [37]. This kind of model allows us to include mul- 
tiple traits (related to size and nesting preference, modeled as functional types) that 
determine movement and decision rules and lead to realistic depletion of pollen in 
space and time. Minimalistic approaches with only home-range descriptions cannot 
account for local competition processes [38]. IBMs with a high level of realism are 
often used in ecology and perceived as a welcome addition to the more theoretical 
approaches with a limited number of parameters [39]. In this chapter, we ask what 
foraging rules are required to simulate foraging behavior with body-size-related 
traits. At the test stage, we ask whether the model produces realistic foraging pat- 
terns in time and how well the response variables overlap with real systems. We also 
ask which parameters are most influential within biological parameter ranges and 
how sensitive parameters are against small changes. 


10.2 SIMULATION MODEL FOR POLLEN-FORAGING 
SOLITARY BEES IN A SPATIALLY EXPLICIT LANDSCAPE 


We describe here the model SOLBEE, a spatially explicit individual-based simulation 
model that mimics solitary bees in agriculturally dominated landscapes. Solitary bees 
forage for pollen individually without communication about food locations (in con- 
trast to honey bees and bumblebees, which try to optimize foraging tasks by commu- 
nicating). Our goal was to develop a mechanistic description of the pollinator-plant 
interaction at the landscape scale with relevant parameters. We implemented several 
body-size-related features that determine flight and pollen-collection behavior of the 
bees. The behavioral rules are implemented in an if-else format that is intuitive to 
follow. The landscape, with patches of flowering plants providing pollen to the bees, 
has several features from coarse-grained structures to fine-scaled pollen release per 
flower. We follow the standardized ODD (Overview, Design concepts, Details) pro- 
tocol [40,41] to describe our IBM. It provides overview, general concepts, and case- 
specific model details in such a way that a model becomes more reproducible. 


10.2.1 Purpose or THE MODEL 


This rule- and individual-based model aims at understanding how wild bees with 
different life-history traits interact with landscape structure and providing insight 
into the bee’s perspective of a landscape. It is designed to be generic and applicable 
to multiple solitary bee species, which are defined by parameters. Many of the bee’s 
traits, and therefore behavior as well, are related to body size. Some traits improve 
performance with body size (such as velocity, handling time, and resource recogni- 
tion distance), while others moderate their performance (such as required pollen for 
a single brood cell). We expect that bees of different size perform differently when 
they collect pollen in a spatially explicit environment. This may also be influenced 
by the spatial allocation of the resources. We compare fitness differences by simulat- 
ing the behavior and time allocation of solitary bees that determine the amount of 
pollen brought to the nest. 


216 In Silico Bees 


10.2.2 Entities, STATE VARIABLES, AND SCALES 


The model comprises a spatially explicit grid-based landscape with a given resource 
distribution and a community of pollen-collecting bees. Table 10.1 shows an over- 
view of the system properties and their values. 


10.2.2.1 State Variables of the Landscape (Environment and Spatial Units) 
The landscape is described at two levels: at the coarse landscape level and the more 
detailed vegetation level (habitat units). We use for the first level a landscape gen- 
erator, which enables the separation of habitat loss and fragmentation as different 
processes and allows for a wider range of foraging habitat availability and fragmen- 
tation than do images obtained from real land-use maps. Habitat availability (or loss) 
and fragmentation are focal variables for our simulations. The landscape is divided 
into habitat units that are either suitable or unsuitable for foraging. Agriculturally 
dominated landscapes are a mosaic of sharply contrasting habitat types [28]. Suitable 
habitat units (second level) are described by flower density, amount of pollen per 
flower, and the proportion of pollen that is available per pollinator visit (regulation 
of flower depletion). These different vegetation-level parameters serve the fine detail 
that is needed at the individual bee level (pollen uptake, flying between flowers) and 
represent homogeneous vegetation (fixed values). Auxiliary parameters describe the 
average distance between flowers and the initial amount of pollen for each habitat 
unit. We track the remaining pollen volume and the number of bee visits per grid 
cell during simulation. 


10.2.2.2 State Variable of the Bees (the Individuals) 


We consider six different types of solitary bees according to three body sizes (body 
length of 6, 12, and 24 mm) and two nesting preferences. Each simulation deals with 
a bee population of one type. Several bee traits are directly calculated from body size 
with allometric scaling rules. These include pollen capacity, flight velocity, flower 
handling time, perception distance, length of flight units (step-lengths"), and return 
distance (Tables 10.1 and 10.3). Several of the bee traits are unrelated to body size 
such as memory size, tortuosity of the flight path, patch-leaving thresholds, and the 
amount of time spent at the nest for nonforaging activities. In Section 10.3.1, we give 
an overview of the main parameters with biological ranges and simulated values, 
accompanied by explanation and references. 

We implemented above-ground (wood and cavity) nesting and subterranean (soil) 
nesting as two distinct nesting preferences. Wood-nesting bees nest in our model at 
the border of foraging habitat with unsuitable habitat (i.e., field edges). Such habitat 
edges are often suitable for nesting in natural landscapes [30,42], since they provide 
shrubs and trees at nesting substrates. Soil-nesting bees nest in the soil at bare spots 
in the vegetation and nest in our model in aggregations everywhere in the foraging 
habitat. The nesting preference in our model has consequences for the spatial dis- 
tribution of bees. Each bee has a fixed start location (nest) to which it must return 
(central-place foraging). 

Six different bee types were selected to represent a wide range of bee genera in 
nature: soil-nesting small bees (6 mm): Dufourea, some bees from Halictus and 
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Lasioglossum; soil-nesting medium-sized bees (12 mm): most bees from Andrena, 
Anthophora; soil-nesting large bees (24 mm): Centris, Eulaema, Oxaea, Habropoda, 
Xenoglossa; wood-nesting small bees (6 mm): Ceratina, Chelostoma, Heriades, 
Hyleaus; wood-nesting medium-sized bees (12 mm): several Osmia, Megachile; 
wood-nesting large bees (24 mm): Xylocopa. 

Different state variables are recorded for each foraging trip (used synonymously 
with foraging bout) for each bee: pollen collected during the trip, distance from the 
nest, number of unsuccessful and successful flower visits per trip, most recently 
visited locations, quality of last visited location, flight direction, start time of the for- 
aging trip, and "future time" to schedule the next behavioral element and current 
spatial location. Data of different foraging trips is collected at the nest; here we record 
(per bee) the number of returns to the nest, pollen delivered to the nest, number of 
flowers probed, maximum distance from the nest, and time spent per behavioral mod- 
ule. Other auxiliary variables keep track of the total distance flown and trip duration. 
At the end of the simulation, the mean amount of pollen collected per bee is converted 
into the (size-related) number of brood cells. We do not use population-level variables. 

We link the landscape and the bee population with a parameter that describes the 
overall landscape quality for bees, which is used for calculating the total number of 
bees in the landscape (section initializations). 


10.2.2.3 Scales 


The simulated landscapes have a spatial extent of 1 km, because solitary wild bees 
respond to landscape structures on scales up to 1,000 m [43]. We used a grain size of 
50 m that mimics raster-based land-use maps and is used in landscape-scale studies 
with solitary bees [44,45]. Lower grain sizes result in very fragmented, grainy 
landscapes that do not realistically represent agriculturally dominated landscapes. 
However, bees perceive landscape structures in more detail [29] especially nesting 
substrate in strips with shrubs and trees [46] and on small tree islands [47]. Bees show 
differences in behavior at a fine scale (see, e.g., [48,49]). We therefore subdivided the 
landscape maps into 5 x5 m cells. Our model landscapes thus consist of 200 by 200 
grid cells. From the perspective of the bee, the landscape contains foraging habitat 
and matrix. The foraging habitat is split up into edge (5 m wide strips, which wood- 
nesting and soil-nesting bees use for nesting and foraging) and interior (used for 
foraging by both bee types and for nesting by soil-nesting bees only). 

Our model landscape has reflecting rather than absorbing boundaries, because 
we deal with central-place foragers that have to return to their nests. Consequences 
of this implementation are discussed under “Details” (Section 10.2.7). We use 
14,400 time steps of 1 s, which equals a foraging period of 4 h. A behavioral unit 
of a bee lasts from 1 to several seconds. The decision of the exact time horizon is 
based on a tuning with the time spent at the nest, which is discussed in simulation 
experiment 1 (Section 10.4). 


10.2.3 Process OVERVIEW AND SCHEDULING 


After the initialization phase, in which a landscape is generated, a bee commu- 
nity is defined (bee traits regulated by allometric scaling, see Section 10.2.5). 


220 In Silico Bees 


A nest site is assigned to each individual, upon which a foraging day starts. The 
virtual bees exhibit five types of behaviors. The behavior of one individual is 
strictly sequential in time and lasts at least for 1 s (discrete time steps). When an 
individual performs a behavioral type, state variables are changed. When a behav- 
ioral type lasts longer than 1 s, a waiting time is set for that individual. Individuals 
are processed in random order at each time step (Figure 10.3a). Waiting times 
imply asynchronous updating of individuals. When a foraging day is completed, 
values are averaged per bee and written to an output file. 

These behavioral modules are performed in a loop until a certain foraging time 
(flytime) is completed after which all activities are stopped instantaneously (fair 
comparison between bees) and values are averaged per bee and written to an output 
file. During behaviors 1, 3, and 4, bees leave visitation marks in the landscape, which 
are used as a measure of pollination potential in the later analysis. Time penalties for 
each bee are given in Table 10.2. 

The five behaviors are as follows (Figure 10.3b): 


1. Forage Flowers (Forage Flowers within a Landscape Grid Cell): A bee flies 
from flower to flower directly (spatially implicit), encounters stochastically 
a full or empty flower (based on present resources), collects pollen, and 
decides about leaving the grid cell. Behavioral states can change into fly 
around (3) (current resources very low) and neighboring cell (2) (current 
resources low), or fly back (4) (enough pollen collected). 

2. Neighboring Cell (Fly to a Suitable Neighboring Landscape Grid Cell): 
The bee considers the eight neighboring landscape grid cells for foraging. 
It accepts one of them randomly when it contains flowers and if it has not 
been visited recently. The behavioral state changes back to forage flowers 
(1) after moving there. On rejection of all eight cells, the behavioral state 
changes into fly back (4) (far from the nest) or into fly around (3). 

3. Fly Around (Fly Around and Look for Unknown Foraging Areas): The 
bee performs a correlated random walk (changes direction and moves one 
step). The behavioral state changes to forage flowers (1) if either the new 
landscape grid cell is suitable (contains flowers and has not been visited 
recently) or if a suitable landscape grid cell has come within sight (move 
second step) or it can change into fly back (4) (too far from the nest). With 
a certain probability, suitable cells are ignored, leading to a more realistic 
foraging behavior (better matrix crossing and better foraging of interior 
habitat; see Section 10.2.8). 

4. Fly Back (Fly Back to Nest): The bee performs a directed random walk 
(correlated random walk in the direction of the nest). Eventually, the state 
changes into nest reached (5). 

5. Nest Reached: The bee delivers the pollen to the nest and spends time 
on nonforaging activities (while other bees still deplete the landscape). 
Afterward the behavioral state is set to forage flowers (1). 
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TABLE 10.2 
Overview of Time Penalties 
Behavior Time Penalties for Value (Minimal 1 s) 
1. Forage flowers Poor habitat grid cell: 
* Assessing patch quality ls 
Good habitat grid cell: 
* Flying to a flower Based on medium/low velocity (size) 
* Full flower: removing pollen Based on handling time (size) 
from a flower 
* Empty flower: assessing flower ls 
2. Neighboring cell * Accepting or denying a ls 


surrounding cell 


* Flying to a surrounding cell Based on medium/low velocity (size) 
3. Fly around * Distance flown per flight unit Based on high velocity (size) 
4. Fly back * Distance flown per flight unit Based on high velocity (size) 
5. Nest reached * Pollen deposition and other 30 s (parameter time at the nest) 


nonforaging activities 


Note: More details on the selection of values can be found in Section 10.3.2. 


10.2.4 DesiGN CONCEPTS 


10.2.4.1 Basic Principles 


We use several known foraging principles such as area-restricted search for resource 
items [8] and a patch “giving up time” [50]. Area-restricted search means that the 
animal has a limited knowledge and memory of the environment and assesses the 
local environment with a fixed-sized search window and inevitably chooses close 
resource points [8]. The decision of an individual to leave a patch is based on actu- 
ally probed flowers and the estimated resource level, rather than by time spent in 
a patch. Resource-based “departure rules” may be more realistic than time-based 
ones [8], and we used resource ratios and thresholds to determine departure [51]. In 
a spatially explicit IBM, this means that bees react to the rapidly changing resource 
levels caused by other foraging individuals. We use the concept of “near—far search” 
as an optimization that is relevant in large patchy environments [52]: bees generally 
forage on nearby flowers, but switch to foraging resources farther away when nearby 
resource levels get low. Such behavior has been shown for solitary bees [44,53]. 
Not-considered concepts that are known for nectar-foraging honey bees or bumble- 
bees include “majoring and minoring” [54], the “matching law,” and the “ideal free 
distribution” [33], because they are not likely to apply to oligolectic (foraging on one 
plant species) pollen-foraging solitary bees. We do not explore or compare the used 
principles; they only serve to achieve realistic foraging behavior. 


10.2.4.2 Emergence 


Complex behavior of bees emerges from five behavioral rules, posing differences 
on individuals during simulation (i.e., different behaviors coexist). Differences in 
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nest positions (and bee densities) cause differences in local competition for foraging 
resources. The amount of pollen collected (or number of brood cells), the mean dis- 
tance flown from the nest (or foraging distance), and the number of flowers visited 
are not coded into the model. Also a spatial “visitation map" emerges from behav- 
ioral rules and landscape structure and is used to calculate the percentage of the 
foraging habitat that has been visited by a bee community. 


10.2.4.3 Adaptation 


The individuals adapt to changing local resource conditions. After visiting and mem- 
orizing the status of a predefined minimal number of flowers (flower memory), the 
habitat cell quality (ratio of full to empty flowers encountered) is compared with 
the quality of the last visited habitat grid cell. According to the relative quality and 
an upper and lower patch-leaving threshold, a bee stays (relative quality better than 
upper patch-leaving threshold) or leaves. 


10.2.4.4 Objectives 


We measure the performance of an individual by how much pollen it can collect 
within a fixed time span. The costs consist of time penalties for each behavioral rule 
(Table 10.2). The amount of pollen collected at the nest is eventually converted to 
a number of brood cells according to body size. For solitary bees, efficiency (and 
hence fitness) can be formulated as “potential number of offspring produced from 
the pollen per unit time on the flower" [55], represented in the model by the number 
of brood cells. 


10.2.4.5 Learning 


The behavioral rules are static without a learning component (the same conditions in 
later foraging trips lead to the same decisions), because solitary bees are considered 
primitive foragers and display less efficient behavior than honey bees [56]. The mem- 
ory of the bees is used for memorizing locations and quality and changes constantly 
(limited memory), but application of this memory is not optimized by learning. The 
sequence of behavioral modes and the outcome of decisions change with time as a 
result of local depletion of flowers and patches. 


10.2.4.6 Prediction 


The individuals cannot predict any future condition, except for the fact that they 
memorize recently visited habitat cells and avoid them because they predict that food 
conditions are low there. 


10.2.4.7 Sensing 

During foraging, bees assess neighboring landscape grid cells for suitable foraging 
habitat (resource availability) by vision and remember if they have visited them 
recently. When flying through unsuitable matrix, they assess the environment with a 
square-shaped search window. Furthermore, they sense the distance to the nest and 
can fly back anytime when they are too distant. The bees do not sense each other and 
therefore experience local competition only indirectly. 
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10.2.4.8 Interaction 


Interaction between individuals exists indirectly through competition for resources. 
Local competition is expected to be highest around the nest, where resources are 
depleted first. Since the nest location is determined by landscape structure and nest- 
ing preference, the magnitude of interaction differs between landscapes, bee types, 
and within a simulation in space and time. 


10.2.4.9 Stochasticity 
We use stochasticity for different goals: 


1. To generate landscapes: The fractal algorithm is partly based on stochasti- 
cally generated noise. 

2. To randomize the sequence and decisions of bees: We randomize the 
sequence of individuals at each time step, assign a random direction at 
the start of the foraging trip, choose randomly from suitable habitat cells 
around, and choose randomly when there are more "nearest locations" 
within sight. 

3. To produce natural variability in behavior and nesting: Natural variability 
is a major element of the correlated random walk (wrapped Cauchy distri- 
bution for turning angles and a normal distribution for flight unit lengths) 
and different leaving thresholds. Nest sites are selected randomly. A land- 
scape grid cell is drawn randomly until one is suitable for nesting according 
to different nesting preferences. Furthermore, we use specified frequencies 
(or a specified fraction) for ignoring suitable habitat grid cells, for deter- 
mining the binary full or empty status of a flower, for clumping of nests 
(soil-nesting bees), and for the probability distribution of maximum return 
distances. In specific cases, we use stochasticity for rounding to integers 
(when the frequency distribution between two is not uniform). 


10.2.4.10 Collectives 


We do not use collectives in our model. Each bee forages solitarily without direct 
interaction with other bees. 


10.2.4.11 Observation 


We record bee performance for each individual as total pollen collected, realized 
and mean foraging range (distance flown from the nest), number of returns to the 
nest, and mean trip duration. For each behavioral module, we record the amount of 
time spent in it. As output variables, we use the arithmetic mean over all individuals 
and the standard deviation. At the landscape level, we record the total number of 
flower visits and visitation marks (grid cells visited, including those without flowers). 
From these visitation marks, we calculate the percentage of seminatural habitat that 
was visited. We record the number of flower visits per bee, as indicator for how the 
pollen vector behaves (but not as an indicator of the performance of the bee, because 
here we do not distinguish between full and empty flowers). 
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10.2.5  INiTIALIZATIONS 


10.2.5.1 Landscapes and Habitat 


We use "noise" from a random number generator (landscape stochastic factor) and 
a Hurst exponent for fractional Brownian motion (landscape fragmentation) and a 
threshold (foraging habitat availability) to generate a landscape [57]. We generate 
landscapes symmetrically and wrapped [58]. Symmetry prevents the entire foraging 
habitat to be in one corner, and wrapped boundaries give the landscape the appear- 
ance to be part of a larger landscape. 

Suitable habitat cells are assigned an initial pollen volume based on flower density 
and pollen per flower. We do not assess a range of landscape metrics for the land- 
scapes, because most landscape metrics are highly correlated in artificial landscapes 
[59]. Instead, we calculate the proportion of available nest habitat (landscape grid 
cells suitable for nesting) according to the nesting preference of the bee. 


10.2.5.2 Allometric Scaling 

The bee traits relating to body size were calculated by allometric rules based on 
the initial body length (Table 10.3). In order to use allometric relationships from 
literature, we first converted body length to intertegular span—the shortest linear 
distance between the wing tegulae [60] —and to dry body mass (data taken from 
[61]). Several traits are directly based on the literature (pollen per brood cell, general 
return distance, far return distance), while others were calculated from data from 
multiple studies (velocity medium/low, velocity high, handling time per flower). We 
use these parameters subsequently to calculate pollen capacity per bee, perception 
distance (and perception area), and length of flight units (Table 10.3). 

A more complex allometric trait is the maximum distance per foraging trip, based 
on homing distance. Homing distance can be considered as the maximum distance 
with knowledge of the environment, which differs between individuals and in dif- 
ferent directions. Allometric scaling of homing distance of bees is known for typical 
homing distance (r50) and far or maximum homing distance (r90) from the litera- 
ture [62]. We connect these two parameters by a saturation curve (Table 10.4) after 
calculating a shift parameter, which represents a certain minimal knowledge (see 
Section 10.3.2 for more details). Within this minimal distance from the nest, bees 
return only with a full pollen load. 


10.2.5.3 Individuals 


We assume our bee community to be in equilibrium with the amount of foraging 
resources. In natural communities, bee density is often related to flower cover [30,63] 
or flower diversity [64,65]. We used pollen volume as resource parameter [61] and 
scaled the number of individuals to the total amount of pollen present in the land- 
scape. More specifically, the total number of individuals is calculated by dividing the 
pollen volume present in the landscape by the pollen volume available per individual 
(Table 10.4). The latter is calculated with the help of the parameter bdc (bee density 
control or landscape quality for bees) as the "potential offspring (brood cells) per 
individual." We set this value at 30, which means that each bee can potentially build 
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TABLE 10.4 
Body-Size-Based Calculation of Individuals and Maximum Flight Distance 
on a Foraging Trip 


Multiple x Calculation of Formula Notes 
A Foraging habitat Individuals (am - total area - Pollen volume available 
availability (am), fd- ppt to the entire bee 
landscape area, (bdc - ppb) community (numerator) 
flower density (fd), and the pollen volume 
pollen per flower available to one bee 
(ppf), landscape (denominator) are 
quality (bdc), pollen calculated in cm?. The 
per brood cell (ppb) total area is 1 km? 
B General return Probability (of (Distance-shift)/ Shift=1.125-r50 
distance (r50), far reaching a distance (Km + distance- — 0.125-r90 
return distance from the nest without shift) Km=r50+ shift 
(r90), distance from knowledge of the 
the nest environment, homing 
ability) 
C Maximum distance (U-Km/ Inverse of distance 
from nest (allowed to 1-U)-« shift probability; U is drawn 
fly per foraging trip) from a uniform 


distribution 


Note: Row labels (A-C) are used in the text. 


30 brood cells from the amount of pollen in the landscape independent of its size 
(equal performance potential for all bees). A large value means fewer bees, but also 
a higher landscape quality per bee. The value chosen (see Section 10.3.1 for a short 
review) results in realistic bee densities in the landscape with high bee numbers for 
small bees and lower numbers for large bees and an increase with increasing forag- 
ing habitat. A disadvantage of this approach is that model runtime varies several 
orders of magnitude for different parameter settings (body length and foraging habi- 
tat availability as well as flower density and pollen per flower). 

Each simulation uses one bee type (according to size and nesting preference), and 
the initially calculated number of individuals remains constant during simulation 
(one foraging day without population dynamics). Each individual has several initial- 
izations. The most important is the nest assignment, which is, in the model, always 
near foraging resources [66]. Wood-nesting bees accept a (randomly chosen) loca- 
tion to nest when it is at the edge of the foraging habitat, and soil-nesting bees accept 
a location all over the foraging habitat but preferably in the vicinity of another bee 
nest in the soil (see Section 10.3.1 for details). Nest distribution depends thus directly 
on landscape configuration. Each bee was additionally initialized with a random 
direction (used in the behavior fly around) and a maximum distance (knowledge of 
the environment). 
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10.2.6 INPUT DATA 


The model does not use time-varying input data [41]. 


10.2.7 Deris 


Here we describe several implementation details and discuss the considerations 
leading to implementation decisions. Data-based selection of foraging rules and 
parameter values follows in separate Sections 10.3.1 and 10.3.2. 


10.2.7.1 Landscapes and Habitat and Boundary Conditions 

We use “noise” from a random number generator (landscape stochastic factor) and 
a Hurst exponent for fractional Brownian motion (landscape fragmentation) and a 
threshold (foraging habitat availability) to generate a landscape with the midpoint 
displacement algorithm [57]. In short, this algorithm creates a three-dimensional 
surface, based on four initial corner points. With “noise” from a random number 
generator (landscape stochastic factor) and a Hurst exponent for fractional Brownian 
motion, the additional grid points are calculated. We did not use the standard C 
random number generator, but an improved algorithm [67]. The three-dimensional 
surface is converted to a two-dimensional suitable-unsuitable map by the “valley 
flooding" method (in which “water” represents the suitable habitat). This method 
had slightly more realistic-looking landscapes than the “mountain-cut” method. 
We use a modified algorithm that allows for symmetrical and wrapped landscapes 
[58]. Symmetry prevents the entire suitable habitat to be in one corner, and wrapped 
boundaries give the landscape the appearance to be part of a larger landscape. 

We implemented reflecting boundaries for bees foraging near the landscape bor- 
der as follows. If the new coordinates for a move are calculated (with a change in x, 
a change in y, and the new coordinate pair), we check whether one of the coordinates 
lies outside the grid. If so, we multiply the change in x, y, or both with —1. This 
means that a line through the old coordinate pair, parallel to the border, functions 
as a mirror. We also prevented nesting at the border of the landscape, to prevent 
increased local competition by the reflecting boundaries. We scale this additional 
rule with body size: the minimal distance from the border where it is allowed to nest 
equals body length as given in meters (i.e., times 1,000 for body length in mm), and 
we rounded it to landscape grid cells. We have chosen this method after thorough 
experimentation with alternatives. The selected method has the best average bee per- 
formance with the least unwanted effects, but a little higher standard deviation (larger 
difference between individual bees) for bee performance. The field was always large 
enough to have most of the bees not nesting near the landscape boundary anyway. 


10.2.7.2 Patch Leaving Rules and Flower Encountering 


The probability of leaving a grid cell is based on the relative quality of the habitat 
grid cell compared with a previously visited one. This is calculated by dividing cur- 
rent habitat quality by the remembered habitat quality. Habitat cell quality is the 
fraction of successful flower visits to the total flower visits (based on a minimal 
number of flowers, fmem). If the upper patch threshold (u pif) is 1.0 and the current 
cell has at least the same quality as the last (value of 1.0 or higher), the probability of 
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leaving is 0.0. If the relative cell quality comes below a certain threshold (/. pif), the 
probability of leaving is 1.0 and the bee flies up in search for a better location (behav- 
ior fly around). A third leaving threshold is determined stochastically (for each deci- 
sion) from a uniform distribution between the upper and lower patch threshold (i.e., 
it differs per moment). If the relative cell quality is below this third threshold, the 
bee will search for resources in neighboring grid cells (behavior neighboring cell). 
For the upper patch-leaving threshold, we have chosen a value of 1.0, which means 
that a bee only stays for certain when the current habitat grid cell is at least as good 
as the previous one. The lower patch threshold should not be lower than 0.5, because 
otherwise bees would stay in a grid cell with less than half of the quality of the previ- 
ous grid cell. 

For determining the success of a flower visit, we first calculated the proportion 
of full flowers in the habitat grid cell. We did not track the pollen volume of each 
flower in the landscape, but the pollen remaining per grid cell. When we divide this 
first over the pollen volume per flower and then over the number of flowers per grid 
cell, we have an estimate for the proportion of full flowers in that grid cell. Since we 
assume homogeneous vegetation, all habitat grid cells have the same amount of flow- 
ers based on flower density. For each landscape grid cell with foraging habitat, we 
track the amount of pollen left, as approximation for the number of full flowers. We 
use the proportion of full flowers as probability for encountering a full flower. If a full 
flower is encountered, the bee takes up pollen according to its uptake capacity, and 
the amount of pollen in that grid cell decreases by the same amount. The bee receives 
a time penalty for collecting the pollen. For both full and empty flower encounters, a 
bee receives a time penalty for flying to the flower (based on distance and velocity). 


10.2.7.3 Determination of the Maximum Distance Allowed to 
Fly on a Foraging Trip (Distance of Certain Return) 

We used the relatively well-studied homing distance to set a maximum foraging 
distance per foraging trip. First, we calculated the typical (r50) and far (r90) hom- 
ing distance (distance beyond which 50% and 90% of the bees were not able to 
return at release, respectively) for a bee of a certain size (Table 10.3) based on a 
known allometric relationship [62]. We use a hyperbolic Michaelis-Menten func- 
tion to describe a homing probability curve. We could solve the equation with two 
parameters (r50 and r90) for a bee of a certain size. Since a Michaelis-Menten func- 
tion normally goes through the origin and we preferred to have a range of x values 
(close to the nest) for which a bee would be able to return (minimal knowledge of 
the environment), we shifted the curve, based on the two known points (750 and r90) 
on this curve (Table 10.4, row B, calculation of shift). We did this by solving the 
altered equation for homing probability (Table 10.4, row B) where 5096 and 9096 
homing probability share the same shift value, resulting in the equation for shift, 
which alters the saturation constant Km accordingly (Table 10.4, row B). The return 
or homing probability can then be calculated as a function of distance from the nest 
(Table 10.4, row B). 

The response homing probability can also be interpreted as the probability that 
an individual has reached the distance beyond which it has no knowledge of the 
environment (will not be able to return home to the nest). 
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We know that bees fly exclusively within their homing range, which differs 
between individuals and within different directions. We decided to include this in 
the model as distance beyond which a bee is not allowed to fly and was calculated 
for each individual, on each foraging bout. We inversed the calculation (Table 10.4, 
row C), giving a stochastically determined distance per foraging trip beyond which 
foraging is not allowed. This reproduces a realistic set of distances from the nest 
where the bee should maximally return, never close to the nest and with a similar 
shape as for real foraging data [68]. An asymmetrical S-curve would probably be a 
good alternative, but we could not fit it with two known points. 


10.2.8 PATTERN-ORIENTED MODELING 


We used a pattern-oriented modeling (POM) approach [69,70] to parameterize the 
behavioral rules of the model. The visitation pattern (grid cells where bees left 
one or more visitation marks) showed that bees with area-restricted search and a 
limited memory easily fly back to old patches and grid cells and never cross the 
matrix (Figure 10.4b). We considered the behavior “too locally optimized." Foraging 
resources appear “in sight," when flying parallel to the vegetation, and such a grid 
cell is visited when it is not memorized (10 last visited grid cells are in memory). 
We added a parameter (ignorance) that lets the bee ignore decisions with a certain 
probability (details in Section 10.3.1). This probability assumes an innate prefer- 
ence of solitary bees to occasionally take the risk of crossing the matrix for finding 


(a) 


FIGURE 10.4 An example landscape with two visitation responses for bee communi- 
ties with slightly different foraging behavior. (a) An example landscape with fragmented 
(meadow-like) fields. The darker shade of gray represents the foraging habitat in an unsuit- 
able matrix. The smallest patch measures 0.25 ha (50 by 50 m, landscape element size). In 
this example, around 1,400 individuals (large bees) nest in woody structures at the border 
of the vegetation. Nests are represented by 1,400 small white dots at edge structures (partly 
sharing the same grid cell and hard to represent at this spatial scale, see also Figure 10.7). 
(b) Visitation by a community of large bees, in the first 8,000 s of simulation. The darkest 
shades of gray represent the highest total visitation and white no visitation (excluding nest 
sites). There is only flight activity around the border where the bees nest, where they find suf- 
ficient foraging resources. The grayscale is optimized to visualize single “visitation marks" 
as well. (c) Visitation of a bee community similar as in (b) but with introduced ignorance. 
Single flight paths can be recognized and the bees cross occasionally the matrix and the inte- 
rior of fields with foraging habitat. 
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far resource patches with higher resource abundance instead of optimizing the 
short-term profit. We decided that a value of 0.1 (ignoring 10% of the optimal deci- 
sions) results in a more plausible foraging pattern (Figure 10.4c). Bees now suffi- 
ciently cross the matrix and search for better patches outside the local patch. They 
also visit more often the interior of a flower field. 


10.3 LITERATURE REVIEW 


This section concerns the ecology of solitary bees. We review the relevant litera- 
ture that we used to develop the model and to select realistic parameter values. We 
aim to identify the complete biological range of the parameters and to identify the 
most common values. We also explain in more detail how we selected our foraging 
rules for the model with literature support. Finally, we explore the literature for the 
response variable of the model that we later use to validate the model. 


10.3.1 NATURAL PARAMETER RANGES, EXTREMES, AND COMMON VALUES 


We discuss the parameters from Table 10.1 with a literature review. The results from 
this review, the biological range of each parameter, is included in Table 10.1. 


10.3.1.1 Body Length 


Body lengths of wild bees normally vary in most parts of the world between 4 and 
28 mm [2]. In the model, we focused on 6, 12, and 24 mm body length for small, inter- 
mediate-sized, and large bees. We chose to model small bees of 6 mm because this 
covers a wide range of common bees from different genera: Ceratina, Chelostoma, 
Heriades and Hyleaus (wood and cavity nesting), Dufourea, and several bees from 
the genera Halictus and Lasioglossum (soil-nesting). Most bumblebees, which are 
wild bees but not solitary bees, range from 12 to 18 mm (10—25 for more extreme 
species). However, we chose a smaller group of solitary bees to represent the outer 
range of body sizes (24 mm). Wood-nesting bees from the genus Xylocopa mea- 
sure 20—28 mm. Soil-nesting bees that are similarly large can be found in the gen- 
era Centris, Eulaema, Oxaea, Habropoda, and Xenoglossa. The main reason for 
including medium-sized bees (instead of only the two extremes) is that they are 
the best-studied group of solitary bees with the most reliable available data. Well- 
studied, intermediate-sized bees (10—14 mm) are found in the genera Osmia and 
Megachile. Soil-nesting, intermediate-sized bees are found in the genera Andrena 
and Anthophora. 


10.3.1.2 Landscape Element Size 

Foraging and nesting resources for bees can probably be considered to have a frac- 
tal patch size distribution in the landscape. Even in large unsuitable regions, some 
smaller patches of several square meters and even single isolated flowers (down to a 
scale of square centimeters) can function as foraging habitats. Despite this, we used 
a coarse grain size (50 m?) for foraging resources for several reasons. Geographic 
information system (GIS)-based landscape maps often use a detail of 50 m? and 
we also used this as grain size for foraging resources, and artificially generated 
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landscapes with a grain size of 30 m were a good imitation of raster-based GIS 
maps in Hargis et al. [59]. Landscape elements with foraging resources are usually 
larger than those with nesting resources. A grain size (or element size) of 50 m as 
landscape detail (or somewhat smaller 0.2 ha blocks) has been used in several wild 
bee studies [44,45,71]. Furthermore, agriculturally dominated landscapes often have 
a patchy structure with large homogeneous blocks, rather than a fractal structure. 
The use of a grain size of 50 m in the landscape generator provides useful maps with 
foraging resources. Since nesting resources for bees are finer scaled (such as linear 
elements with scrubs or bare spots in the vegetation), we defined nesting resources 
with another method. 


10.3.1.3 Flower Density, Pollen per Flower, and Pollen Availability 

Flower density is a highly variable parameter. For solitary bees, the unit for visita- 
tion is the flower or flower head and not the plant. Flower densities are much higher 
than plant densities. For a homogeneous vegetation, flower density ranges from hun- 
dreds (Caltha palustris) to millions (Thalictrum aquilegiifolium, Ranunculaceae) 
per square meter [72]. High flower densities are often based on florets and not on 
flower heads, for example, from Centaurea species [73]. For nectar collection, these 
are probably realistic visiting units for bees. Active pollen collection by solitary bees 
is nevertheless a process on the flower(-head) level. The highest density we could 
find for single flower units (not composite flowers) was for Brassica napus (oilseed 
rape) and counted to more than 11,000 m? [74]. Lower densities can have any value. 
For clover, the flower(-head) density was counted at 50 inflorescences/m? [48] but 
Waddington reported a range of 50-250 [75]. Large flowers such as sunflowers are 
an exception and have a density below 10 m 2. Other low flower densities reported 
are often a result of downscaling flower densities from heterogeneous units on a 
larger (hectare size) scale. 

The amount of pollen per flower varies considerably between species. Studies 
used different measurement units for pollen production and assessed them with 
various methods and only few compared different plant species with a wide range 
of pollen production. The first way to measure pollen production is by number of 
grains, which ranges from 1,100 to 150,000 [76]. A second method is by weighing 
the amount of pollen, which varies from 0.35 to 6.11 mg for Ranunculaceae [72]. The 
third method is by calculating the pollen volume for each flower, which ranges from 
0.05 to 21.7 mm? [61]. For both pollen number and pollen weight, lower values can be 
found [77,78], but we did not find higher values. Calculating the pollen volume [61] 
is a relatively new approach without comparable studies, but the authors put special 
effort in covering a wide taxonomical range. We used pollen volume, because the 
most qualitative information of pollen transport by bees is measured in volume [61] 
and therefore in the same unit. 

We use an additional parameter for pollen availability to regulate pollen removal. 
Many plants release pollen in portions in order to reduce the pollen that is taken 
in one visit and help the plant in optimizing pollination. There are many different 
syndromes for regulation of pollen release, which are widely distributed in the plant 
kingdom [79], and there are no general rules for gradual release and depletion of 
pollen. Our model flower does not mimic a certain flower type. We use a pollen 
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availability of 0.3 per visit, a very general value. This maximum proportion of avail- 
able pollen (initially present) at one moment is a plant trait and independent of bee size 
and allows for a minimum of at least three to four bee visits to the flower before being 
empty. Percentages of pollen removal at a first visit (bumblebees) vary from 20% to 
80% [80,81]. Depletion rates vary from almost all pollen from all plants after 2 h [82] 
to 6096 of the pollen per flower after 3 h [83]. Some pollen will never be removed, 
about 196; see [83]. We also use decision thresholds in the model (explained later) that 
prevent bees to spend too much time on flowers that provide little (remaining) pollen. 

We tried to balance these three different flower parameters in the model. The 
flower density and pollen production per flower regulate the amount of pollen per 
square meter. Field data (see, e.g., [72]) does not reveal a direct relationship between 
flower density and pollen production per flower, but still indicate a weak trade-off 
between flower number and pollen per flower (highest flower densities show a low 
pollen production per flower). We used 50 flowers/m? as flower density with a rather 
oligolectic bee in mind that only visits flowers of a certain species that has a more 
scattered distribution. In contrast, polylectic bees often visit many different flowers 
that have a high combined density. 

There is, to our knowledge, no evidence that the size of the flower (and hence 
pollen production) is correlated with the size of the flower visitor; single plant spe- 
cies are visited by a diverse bee fauna, for example, [84,85]. 

Therefore, we model one flower type with a certain amount of pollen visited 
by all bees of all sizes. We decided to use relatively small flowers so that also the 
smallest bees have to visit several flowers before they have collected enough pollen. 
Therefore, we used a pollen volume of 0.5 mm*?. This value is also close to the mean 
pollen volume of 0.6426 mm? for one flower or flower head calculated from the data 
provided by Müller et al. [61]. In the analysis of the model, we explore the conse- 
quences of these parameter values, with more extreme values for both flower density 
and pollen per flower in simulation experiment 2 and the effect of moderate changes 
in pollen availability in simulation experiment 4. 


10.3.1.4 Landscape Quality for Bees 


We used the parameter landscape quality for bees to set a basic bee density in the 
landscape that also varied with body size. A higher value implies lower bee densi- 
ties and more available pollen per individual. Bee densities in the literature are often 
given in estimated number per hectare. Bee densities differ between natural habitats 
and crop areas. Density of Apoidea in natural grasslands was estimated at 256—1,500 
individuals per ha and at 232—4,700 ha”! for alfalfa fields. Bee densities vary through 
the season with higher densities in spring [30]. For other habitats such as forests, 
woodlots, roadsides, and village parks, the estimates were lower, varying from 46 to 
281 individuals per ha [86]. 

The parameter values for flower density and pollen per flower (Table 10.1), in 
combination with a value of 30 for landscape quality for bees, yielded between 
204 and 87,209 bee individuals per km?. This span is caused by differences 
in body length and foraging habitat availability in the different landscapes. A 
low landscape quality value of 10 in combination with high resource conditions 
increased the number of individuals to 92,819 and 2,093,017 for large and small 
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bees, respectively. Scaled to 1 ha (divided by 100), it becomes clear that these are 
still realistic densities. For seminatural habitats, a value of 30 yields more realistic 
densities (2—900) than a value of 10 (900-21,000) and is in balance with our mod- 
erate resource densities. Note that for extremely high values for flower density and 
pollen per flower (simulation experiment 2) extremely high individual numbers 
can occur in the model. 


10.3.1.5 Pollen per Brood Cell and Pollen Capacity per Bee 

The pollen volume that a bee requires for a brood cell clearly relates to body size 
[61] and was not further reviewed by us. The pollen volume transported by a bee 
per foraging trip is unknown, but it may scale in the same way with body size as the 
complete brood cell volume. Therefore, we assumed an average of 10 foraging trips 
per brood cell to define the capacity per bee. We assume a 1:1 sex ratio to cancel out 
effects of sexual dimorphism [87]. It is not clear whether the number of foraging 
trips per brood cell can be used as a constant, since sexual dimorphism and other 
factors cause variability. The number of collection trips per brood cell varies from 
3 to 15 trips between species [88,89]. A range of other species, with a large span in 
body size, need 8-12 trips per brood cell [88,90,91], which suggests that 10 is an 
acceptable choice. 

We made one other assumption with regard to the pollen capacity of bees and 
their behavior. In rare cases, the smaller bees find flowers with more pollen than 
they can transport. Bees deal with this in different ways. While one species com- 
pletes the pollen load during a single visit, another species (from the same genus) 
visits several flowers regardless of pollen availability [91]. We argue that a bee 
needs to visit at least two flowers to be biologically meaningful to flowers. When 
the pollen available per visit from a flower exceeds the transport capacity of a 
bee (which means that the bee would be fully loaded), we set the pollen avail- 
able to half of the normal availability. This rule was only invoked under extreme 
parameter combinations (e.g., very large flowers with abundant pollen in simula- 
tion experiment 2). 


10.3.1.6 Velocity 


In the literature, we found hymenopteran velocities from a wide taxonomic range, 
but almost none for solitary bees (Table 10.5). The listed values cover a wider range 
of body lengths than in solitary bees and were used to provide an allometric rule for 
high velocity and medium velocity. 


10.3.1.7 Flower Handling Time 


Handling times for exclusive pollen collection are rare in the literature, and most 
studies report handling times for mixed foraging tasks or for nectar handling alone. 
For the allometric scaling of pollen handling time with body length, we used three 
studies (Table 10.3). The first [102] gives values for five solitary bees and shows that 
handling time decreases with body length (Table 10.6). Solitary bees alone had a 
very narrow range of body sizes and we therefore included a honey bee and a bum- 
blebee [103,104]. Data from another study with much longer handling times shows a 
similar negative relationship [4]. 
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TABLE 10.6 
Flower Handling Times for Pollen Collection Based on Three Studies 


Solitary Body Length Handling Time for 


Species Hymenoptera Bee Bee (mm) Pollen Collection (s) 
Hoplitis anthocopoides y y 10.0 5.70 [102] 
Megachile relativa y y y 10.0 10.40 [102] 
Osmia coerulescens y y y 9.5 15.70 [102] 
Hoplitis producta y y y 6.6 29.30 [102] 
Ceratina calcarata y y y 6.2 31.70 [102] 
Bombus terrestris y y n 26.0 4.60 [103] 
Apis mellifera y y n 12.0 8.10 [104] 


10.3.1.8 Perception Distance and Length of Flight Units 

There is no direct data on the perception distance of bees, but a body of literature 
exists on the visual abilities of bees showing that larger bees have better visual abili- 
ties. Eye size (facet or ommatidium diameter) of wild bees scales isometrically with 
thorax length [105]. Bees estimate their flight distance with the help of their velocity. 
Insects experience image motion (near objects appear to move faster than distant 
ones), mainly in a horizontal direction [106]. Honey bees estimate distance by hold- 
ing a constant image velocity [107]. Because of the close link between velocity and 
perception, we defined the perception distance as the distance that can be flown in 
10 s (view of 10 s forward). Since bees fly at several meters per second, the percep- 
tion distance is several tens of meters. This may seem rather limited but wild bees 
generally fly 1-3 m above the ground [108] rather than higher up in the air with a 
wide view of the landscape. 

We use flight units to model flight paths of bees, since flight paths are rather 
erratic than straight. Such flight paths suggest that a bee regularly evaluates (and 
adjusts) the flight direction. We defined a flight unit length as half of the percep- 
tion distance and it was hence related to body size as well. In our implementation 
of movement (correlated random walk), we use slight deviations from this mean 
flight unit length in order to create natural-looking flight paths. We did not include 
any odometry in the model, because odometry only plays a minor role during 
foraging [109]. 


10.3.1.9 Flower Memory, Habitat Cell Memory, and Ignorance 

Bees have different kinds of memory (e.g., [110]). We use flower memory and habi- 
tat cell memory in our model, since they play an important role in decision behav- 
ior. Bees need to probe and memorize several flowers to estimate patch quality. 
We defined patch quality as the ratio of full to empty flowers, which reflects the 
probability that the next flower is full. Data from solitary bees show that the decision 
to stay or leave (a patch) depends on the reward of at least one to three visited flowers 
[111]. We used a minimum of three flowers for flower memory. One flower (full or 
empty in the model) does not suffice for a patch quality estimate. Bees improve their 
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estimates of patch quality by visiting more (than three) flowers. Since this kind of 
working memory lasts from seconds to minutes [112], we did not set a maximum of 
flowers that a bee can remember. Within minutes, the bee either found enough pollen 
or left the habitat grid cell. Apart from the fixed minimal number of flowers that must 
be probed (flower memory), we implemented further flower memory during forag- 
ing within a habitat grid cell as two numbers: the number of full and the number of 
empty flowers. On entering a new habitat grid cell, only the final ratio of full to empty 
flowers is remembered and acts as the expectation of resource quality to compare the 
new experience (new series of probing flowers) with. 

Bees remember the most recently visited grid cells with flowers (5 by 5 m units 
within the larger-scale foraging habitat). It is not exactly known how bees remem- 
ber this kind of information, but they have a spatial memory of their route and the 
landscape with landmarks [113]. We defined this memory (habitat cell memory) as 
10 grid cell locations. We cleared this memory for each new foraging trip, leading 
to new exploration of flower habitat grid cells (including near the nest) and new 
foraging directions. 

We introduced an “ignore parameter" to induce matrix crossing and “far resource 
exploration." Wild bees do not prefer to cross the matrix [46,114]. However, absence 
of matrix crossing is also unrealistic since some individuals do take that risk (about 
10%) [46]. Therefore, in the model, 10% of the local optimal decisions (going to a 
close habitat cell) are ignored. We decided to scale the parameter with habitat cell 
memory to reduce the number of independent parameters. They are inversely related 
(probability of 1 divided by the habitat cell memory), which means that for a bee 
with very little memory of its environment it is better to take more risks. 


10.3.1.10 Flight Path Tortuosity 


The turning angle distribution determines the tortuosity (erraticness) of the flight 
path. A higher value for flight path tortuosity results in more small turning angles 
and straighter flight paths. Turning angle distributions differ considerably between 
studies [115—119]. We use the correlated random walk with turning angles only to 
cross the matrix (area with no flowers); at the foraging habitat level, we use near- 
est neighbor selection rules (which indirectly lead to a very erratic flight path). 
For the matrix-crossing flight, we used a high value for flight path tortuosity (0.9), 
resulting in relative straight flight paths as known for areas with almost no foraging 
resources [118]. 


10.3.1.11 Time at the Nest and Foraging Time 


The time that bees spent at their nest between foraging trips varies from 0.5 to 
30 min [88]. A time below 5 min has been reported most often [91,120—122]. Time 
spent at the nest can be separated in a short time at the nest for pollen deposition 
(short stay) and longer time for egg laying and cell closure after a completed brood 
cell provision [121]. We do not know of an effect of body size (e.g., data collected in 
[88]) and nesting preference, but this may be a knowledge gap in the literature. We 
use fime at the nest as pollen deposition time and assume that larger species remove 
pollen more efficiently (same amount of time for depositing more pollen) and use 
0.5 min as value unbiased by other activities. Instant pollen deposition at the nest 
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(time zero) would lead to unrealistically high levels of local competition, and a high 
value would lead to a very low competition between bees, because they spend most 
time at the nest. 

We simulate one foraging day to measure the bee's foraging performance, assum- 
ing that days do not differ. This also keeps simulation time acceptable compared to 
multiple foraging days. Foraging time (flytime) is often described in the literature as 
species activity time lasting 8—12 h [120—124], but can be considered to be half of 
that value (4—6 h) for the peak activity time [120,121]. Foraging time (time of day 
used for foraging) also relates to body size and climate. Large species can generate 
more heat, which is needed to start earlier [125]. However, they also forage late in the 
day, but have low foraging activity at the middle of the day [126]. Hence, duration of 
peak activity may be considered equal between small and large species. Animals 
often restrict their food search to the optimal time as response to the periodic nature 
of temporal distributions of resources [127]. We therefore consider four to eight peak 
foraging hours as realistic values for foraging time. The combination of time at the 
nest and flytime determines how much pollen has been collected by the end of the 
day, and possible qualitative differences of different combinations are explored in 
simulation experiment | (Section 10.4). 


10.3.2 DATA SUPPORT FOR FORAGING RULES 


10.3.2.1 Five Behavioral Modules 

Resource competition in time with time penalties for different tasks is an important 
concept for modeling foraging behavior of wild bees. Bumblebees spend their time 
performing different behaviors: they travel between nest and foraging patches, fly 
between flowers within a patch, handle flowers and remove nectar and pollen, and 
search for other rewarding patches [36]. For solitary bees, these tasks are the same. 
We modified these tasks to five different behavioral modules in the model: 


1. Forage flowers (fly to flowers, forage flowers within a landscape grid cell, 
fly between flowers, handle flowers, and remove pollen) 

2. Neighboring cell (fly to a suitable neighboring landscape grid cell) 

3. Fly around (fly around and look for unknown foraging areas) 

4. Fly back (fly back to nest) 

5. Nest reached (deposit collected pollen) 


The finding that some bees perform an exclusively nectar-feeding trip at the end of 
the day [121] was not included. 

There are several indications that bees first deplete flowers in the closest patches 
around the nest. Solitary bees deplete all flowers under high bee densities [91] 
and some individuals keep small foraging areas [128]. Bumblebees forage differ- 
ently compared to solitary bees by following traplines (foraging paths of consid- 
erable length that guide farther and farther away from the nest), but solitary bees 
forage more primitively within a few hundred meters of their nest [55]. Therefore, 
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after behavioral module 5 (nest reached), bees start foraging again from the nest 
location. Pollen may also still be available, since the flowers did release only a pro- 
portion of their pollen (pollen availability) in one time. The higher expected patch 
quality (memorized from farther away at the preceding foraging trip) makes that the 
bee flies beyond the habitat cells near the nest with low resource levels. 


10.3.2.2 Use of Memory 


According to the current knowledge, five memory types can be distinguished for 
(eusocial) bees [110]: 


1. Memory of link between olfactory stimulus and reward, which lasts only 
seconds (flower constancy choice) 

2. Short-term memory of, for example, the last visited patches, which lasts up 
to several minutes 

3. Mid-term memory of the last location of rewarding flowers when returning 
to nest, memory of sequential landmarks and time of day 

4. Long-term memory of flower cues 

5. Long-term memory of nest location (nest recognition cues) 


We represent these levels of memorization in our model as follows: 


1. Bumblebees use this memory for maintaining flower constancy, but the 
solitary bees in our model forage on one kind of flower. Nevertheless, the 
model bees memorize the numbers of empty and full flowers that they have 
encountered and remember the current patch quality. The minimal number 
of flowers needed to estimate a ratio between them is defined in flower 
memory. 

2. The bees in our model remember the last visited habitat grid cells. The size 
of this memory (number of memorized locations) is defined in habitat cell 
memory. 

3. Honey bees return to rewarding patches [110], but we assumed that solitary 
bees do not for several reasons. We are not aware of any study showing 
that solitary bees directly return to the previous rewarding patch; it is even 
doubted for some honey bee subspecies [129]. Bees that have low associa- 
tive learning capabilities, behave more like individuals, and fly shorter dis- 
tances from the nest are likely to visit different locations on different bouts 
[129]. Instead, we assumed that the bees remember the quality of the last 
visited habitat grid cell (ratio of full and empty flowers encountered) for 
comparison with a newer location. We also indirectly assumed a memory 
of landmarks, resulting in a nonstraight flight path back to the nest (directed 
correlated walk). 

4. The solitary bees in our model forage on one kind of flower. Hence, recog- 
nition of the right flower (and flower cues) is assumed, not modeled. 

5. The most basic memory of the bees in our model was their nest location to 
which they always return. 
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10.3.2.3 Within-Patch (Grid Cell) Foraging Behavior 
(Behavior 1: Forage Flowers) 

We reduced the biological detail within a habitat grid cell and made very simplified 
assumptions about foraging behavior. Remember that we do not use optimized foraging 
behavior (shown for nectar-foraging bumblebees) for the pollen-collecting solitary 
bees in the model. Further, we were interested in motivations of bees for moving 
between grid cells (landscape level), not in detailed movement within a grid cell. We 
implemented a “visit nearest flower” rule and resource evaluation rules (determining 
flower and patch quality). We considered the following facts for our implementation: 


* Pollen-collecting solitary bees do not use scent marks as much as nectar- 
foraging bumblebees do [130]. Flowers normally have abundant pollen (in 
contrast to nectar), and marking flowers is less profitable and too costly. 
Pollen is also mostly easily accessible than nectar. In the model, we do not 
use any kind of marking. 

* Solitary bees are able to assess nectar reward by scent [131], but pollen 
recognition by scent has not been shown so far. We do not use a perception 
rule on this scale. Our model bee flies to a flower and receives a small time 
penalty for assessing pollen availability. 

* Hlight distance of bees flying between flowers is related to plant density 
[55]. We modeled the distance to the next flower as the mean distance 
between flowers, based on flower density. 

* When bees forage on flowers, they use color contrast of multiple receptor 
types instead of the green contrast receptor type alone [132-134]. In order 
to locate a visible flower in the third dimension, bees need to adapt their 
velocity [106] and trade-off speed for accuracy [135]. We used therefore a 
lower velocity for within-patch (within-cell and between-cell) movements. 


10.3.2.4 Patch Selection (Behavior 2: Neighboring Cell) 

Honey bees cross vegetation structures very easily, but solitary bees were found 
to follow continuous vegetation structures [124]. We therefore implemented a mod- 
ule where only neighboring habitat cells are visited. The currently occupied cell is 
excluded from choice possibilities as well as recently visited habitat cells and nonfor- 
aging habitat cells. From the remaining cells, one is chosen randomly. This leads to 
a more or less random movement between habitat cells and a uniform distribution of 
turning angles with a larger-scale tendency to fly away from the nest. This movement 
behavior is not in contradiction with turning angle distributions found for bumble- 
bees in rewarding flower patches [118,136]. 


10.3.2.5 Nest Clumping for Soil-Nesting Bees 

For a more realistic distribution of nests for soil-nesting bees, we distributed them some- 
what clumped rather than uniformly. Soil-nesting bees prefer moderate [91] to very 
dense aggregations [137,138]. Not all locations within the vegetation are suitable to nest, 
and clumped nest sites are also better encounter sites for mating [55]. We used moderate 
clumping in our model (and did not further analyze this), since we were interested in the 
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potential difference between soil- and wood-nesting bees and not in the effect of nest 
clumping (it does not change the contrast of the two nesting preferences per se). 


10.3.3 EXPLORATION or FIELD DATA FOR RESPONSE VARIABLES 


We discuss here response variables of the simulation model: number of brood cells, 
distance flown (mean and far distance from the nest), trip duration, and number of 
flowers visited (per day and per trip). We discuss values for small, midsize, and large 
bees separately to get an indication of the range of values within each group. 


10.3.3.1 Number of Brood Cells 


The number of brood cells that bees build in 1 day spans a large range between 
species and within species. Bees from the genus Andrena (covering probably the 
whole range of small to large bees) build 0.4—2 brood cells a day [88]. The small 
bee Calliopsis persimilis («8 mm) even builds up to 6 a day [121]. Intermediate- 
sized bees are relatively well studied. Osmia cornuta builds half a cell a day [139], 
Andrena humilis builds 1.37 brood cells per day [88], Osmia lignaria can build 
2 cells a day [44], and Diadasia rinconis builds 2-3 cells a day [91]. However, 
Osmia bicornis may build up to 7.1 cells a day in optimal conditions [122]. A large 
bee, Creightonella frontalis, was found to build 1 cell a day [140] and another one, 
Dieunomia triangulifera, 0.2—3 brood cells per day [141]. This suggests in summary 
that small bees are able to build more brood cells in 1 day than large bees. 


10.3.3.2 Foraging Trip Duration 

Trip duration of different solitary bees (body length 7-12 mm) lasts 6—28 min and is 
positively correlated with body length [142]. Another review found that trip duration 
for different species varies from 3 to 170 min [88]. Small bees show a particularly 
large range of trip durations. Perdita opuntiae needs about 4 min per trip, P. texana 6 
min, and other Perdita species 15-30 min [91]. Calliopsis persimilis has foraging 
trips of 8 min [121], Chelostoma florisomne has pollen collection trips of about 20 
min [143], and trips for Lasioglossum figueresi last 7—46 min [144]. For intermediate- 
sized bees, the range is less extreme. Osmia cornuta for pollen collection in apple 
orchards needs 4.7 min per trip in one experiment [120] and in another experiment 
5-6 min [122] and in almond orchards around 12 min [87]. For O. cornuta and O. 
rufa, it is known that they have series of longer (8-17 min) and shorter trips (1-4 min) 
[122]. For Andrena humilis foraging trips range from 2 to 35 min [88]. Large solitary 
bees have longer foraging trip durations. Anthophora acervorum needs 14 min per trip 
in apple orchards [120], Xylocopa pubescens and X. sulcatipes need on average 20—30 
min per trip (which was equal for pollen and nectar trips) but could last up to 78 min 
[145], Creightonella frontalis takes about 17 min for pollen collection [140], and for 
Dieunomia triangulifera, the trip duration varies from 20 to 190 min [141]. 


10.3.3.3 Flowers Visited and Flowers Visited per Trip 

Small bees visit fewer flowers than large bees [85], and they visit only a few flow- 
ers per foraging trip [146]. It was estimated that Osmia cornuta (an intermediate- 
sized bee) visits about 50 flowers per trip and about 4,500—5,600 flowers a day. 
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Others estimate 60—90 flower visits per trip for O. cornuta [87], which would mean 
about 10,000 flowers a day. Large bees visit most flowers. Anthophora acervorum 
is estimated to visit about 250 flowers per trip and about 8,800 flowers a day [120], 
Creightonella frontalis 29 (full) flowers per trip and about 180—300 (full) flowers a 
day [140], Xylocopa pubescens and X. sulcatipes 15—20 (full range 4—65) flowers per 
trip [145], and bumblebees 20—150 flowers per trip [146]. 


10.3.3.4 Mean Distance from Nest and Realized Foraging Range 


Small bees forage near the nest. Perdita texana has most foraging activity within 
20 m from the nest with the longer flights around 40 m from the nest [91]. Also, 
Calabuig found that most solitary bees (among many small ones) forage mainly 
within the first 27 m [63]. An experiment with fluorescent dye showed that most pol- 
len was transferred over short («15 m) distances [147]. The mean activity distance 
for an intermediate-sized bee, Andrena hattorfiana, was 46—76 m (two sites), and the 
maximum distance was 83-130 m. Rare long dispersal movements (which can be 
assumed to come close to the homing distance) were up to 900 m [46]. In resource- 
rich environments, Osmia cornuta forages near the nest within 100—200 m [148]. 
Bumblebees (large bees) are in contrast to small solitary bees and are also frequently 
flying farther (100—200 m) from the edge [63]. For other bumblebees, it was found 
that 40% foraged within 100 m around the nest and 62.5% within 200 m [149]. The 
mean maximum foraging distance per colony varied from 460 to 710 m, and all 
bumblebees foraged within 800 m. The mean foraging distance varied from 87 to 
447 [149]. When food is abundant close to the nest, as it is, for example, in a clover 
field, bumblebees have their main foraging activity within 18 m from the nest [150]. 


10.4 EXAMPLES OF SIMULATION EXPERIMENTS 


We performed four simulation experiments in order to gain a basic understanding of 
the model and to understand the influence of the different parameters. These experi- 
ments include the basic calibration and validation of the model as well as exploration 
of global perturbations within the parameter space and quantifying local sensitivity 
of the parameter values. These simulation experiments can be considered as exam- 
ples of how one can analyze a multiparameter model such as our individual-based 
simulation model. At the same time, these simulation experiments can yield a basic 
understanding of the model system. In our case, they give insights into how solitary 
bees experience the landscape. All parameters are listed in Table 10.7, and for each 
simulation experiment the used values are given. 

Statistical analyses on simulated outputs were performed with R [151]. Statistical 
analysis of simulation results is relatively unusual since the majority of the model 
is deterministic, which means that all parameters have a significant influence. 
However, the model has many rules that interact so that we could not predict a priori 
which of the parameters would have the most effect on the response variables, and 
statistical tools can help in ranking the impact of different parameters. We look at 
different response variables: number of brood cells, number of flower visits, mean 
distance from the nest, and foraging habitat visitation. In simulation experiment 1, 
we additionally look at the mean trip duration and the maximum foraging distance. 
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10.4.1 FORAGING FOR POLLEN: COMPETITION PROCESSES IN TIME 


In this first simulation, we performed a systematic exploration of the model. We 
assessed how the model behaves over time, and how well output parameters over- 
lap with literature data. There are two parameters in the model that determine the 
global time budget for bees: foraging time (flytime) and the time spent at the nest 
for pollen deposition (time at the nest). Since field data cover a wide range of values 
(Section 10.3.1), we investigated whether different combinations have only quantita- 
tive or also qualitative effects. We simulated three time-budget scenarios: a foraging 
day of 4 h with 6 s at the nest after each foraging bout, a foraging day of 8 h with 
60 s at the nest, and a foraging day of 16 h with 600 s at the nest. We used unequal 
intervals for time at the nest for two reasons. First, it suits the biological values best 
(Section 10.3.1) and second, we expect that with longer foraging days the relative 
effect of time at the nest decreases (due to longer foraging trips and farther foraging 
distances). We explored a system that is unsaturated with bees (where there is more 
pollen than what bees collect in one day, defined by bdc). We varied body length 
(6, 12, 24 mm) and explored the results for the three bee sizes separately. To reduce 
complexity we omitted bee sizes from the description of the results when they did 
not provide additional insights. We therefore describe time series for brood cells and 
flower visits for small and for large bees, and the other time series for large bees 
only. We simulated four combinations of nesting preference (two types) and forag- 
ing habitat availability (0.05 and 0.95). This gives 12 time series per bee size (Table 
10-7). Within each time-budget scenario, we ranked the four time series (their values 
at the end of the simulated time) to trace qualitative differences. 


10.4.1.1 Number of Brood Cells 

Within the foraging time (flytime), the number of completed brood cells increased. 
The pattern for different time-budget scenarios was similar between small bees 
(Figure 10.5a) and large bees (Figure 10.5b) as well as for intermediate-sized bees 
(not displayed). The flytime determined the absolute number of brood cells that could 
be built in 1 day, and the time at the nest determined how fast (change in slope) a 
certain number of brood cells is built. The relative distance between different values 
for the time at the nest (6—60—600) is reflected in the relative distance between the 
curves. These two time-related parameters did affect the time budgets and remain- 
ing time for pollen collection as expected. The ranking of the performance (brood 
cells) of the bee types (ranking of the four response curves) was equal for all three 
time-budget scenarios. 

The number of brood cells increased linearly for soil-nesting bees in all cases, 
which means that they were not resource limited by competition. Wood-nesting 
bees performed badly when they faced a high foraging habitat availability, which 
may seem counterintuitive. The increase in brood cells additionally leveled off for 
them, as well as for wood-nesting bees in landscapes with low foraging habitat (but 
weakly). These striking differences may be related to the different distribution of 
nests between soil- and wood-nesting bees, which induced other time constraints 
(Figure 10.7). Small bees were able to build more brood cells than large bees, and no 
bee was able to collect pollen for 30 brood cells (as defined in bdo). 
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FIGURE 10.5 Development of different response variables during simulation time. Each 
graph contains 12 time series, of which 4 have the simulation time (flytime) ending at 14,400 s 
(first dashed vertical line), another 4 at 28,800 (second dashed vertical line), and the last 4 
outside the graph on the right (at 57,600). Each subset of four represents a different scenario 
according to nesting preference and foraging habitat availability. The curves of each of the 
four scenarios are directly comparable with the curves in the other two time-budget scenarios 
(set 1-3). Note that we cut off the top of the y-axis to visualize the lower values so that some 
of the curves reach the vertical dashed line (simulation end) outside the plot. We shifted the 
lines for "high foraging habitat availability" with 500 s to make them distinguishable from 
other lines. (a) Brood cells built by small bees, (b) brood cells built by large bees, (c) flowers 
visited by small bees, and (d) flowers visited by large bees. 


10.4.1.2 Number of Flower Visits 


The number of flowers visited per bee (full and empty flowers) increased exponen- 
tially for all bees (Figure 10.5c and d). Hence, bees probed more flowers per time 
unit hinting to more empty flowers later in the day. Large bees (Figure 10.5d) visited 
many more flowers than small bees (Figure 10.5c). For most bees, the increase in 
flower visits was almost linear (Figure 10.5c and d), while for some small bees there 
was a strong exponential increase (Figure 10.5c). 
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We suspect that large bees and soil-nesting small bees (Figure 10.5c and d) had 
better access to full flowers than wood-nesting small bees (Figure 10.5c). Wood- 
nesting small bees visited more flowers per time unit later in the day and they built 
fewer additional brood cells per time unit (Figure 10.5a). Hence, they faced more 
empty flowers, leading to a higher flower visitation rate. Their nest position at the 
border of the habitat and their higher numbers and lower flight capability may have 
limited their access to less depleted areas. 

The ranking of the response for the different bee types was the same again under 
the three time-budget scenarios, except for large bees with ntime 600. At this point, 
we cannot give a sufficient explanation for that. Time budgets for flower visits were 
apparently not the same time constraints that determined the pattern for the number 
of brood cells (Figure 10.5a and b). 


10.4.1.3 Normal Foraging Activity and Far Foraging Activity 

Far foraging distances (Figure 10.6b) were in most cases about twice as large as 
mean foraging distances (Figure 10.6a). Foraging experience (distance) increased 
almost linearly for soil-nesting bees and did not reach high values indicating that 
they found foraging resources close to the nest. Wood-nesting bees flew farther 
than soil-nesting bees, especially when they were in a landscape with high foraging 
habitat availability (Figure 10.6a and b). Wood-nesting bees were forced to nest in 
edge structures, while soil-nesting bees were more or less evenly distributed over the 
foraging habitat. Since in landscapes with high foraging habitat availability there 
were more bees and less edge (Figure 10.7), depletion around the nest was more 
likely for wood-nesting bees and resulted in farther foraging from the nest. 

The expansion rate of bees decreased with time (Figure 10.5a and b). We imple- 
mented a foraging rule that prohibited flying too far from the nest (Section 10.2.7) and 
that could have caused this. We used parameters r50 (typical homing distance) and 
r90 (the far homing distance) to rule out exceeding these distances for 5096 and 9096 
of the flight trips, respectively. The value for large bees was 6,760 m for r50 and 
16,017 m for r90. Large bees never reached these distances (Figure 10.6a and b), and 
this hard-coded foraging rule cannot have been the cause for the decrease in expan- 
sion rate. All patterns in Figure 10.6a and b are in agreement with Figure 10.5a and 
b and may indicate that longer flights directly result in fewer brood cells. 

There were no qualitative differences (same ranking) between the three time- 
budget scenarios. Far foraging distances (Figure 10.6b) were based on rarer expan- 
sion events, and the increase was therefore less smooth and more stochastic. 


10.4.1.4 Expansion over the Foraging Habitat 

The model tracked at the landscape level how much of the foraging habitat was 
visited by the bee community (Figure 10.6c, large bees). Soil-nesting bees covered 
within 3,000 s the complete vegetation (100%) in landscapes with low foraging habi- 
tat availability and 90% of the vegetation in landscapes with high foraging habitat 
availability. This means that they had good access to all foraging resources without 
depleting it within a foraging day (brood cells increase with the same rate throughout 
the day, Figure 10.5a). Wood-nesting bees that nested at the border of the foraging 
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FIGURE 10.6 Progress during simulation time of expansion-related parameters for large 
bees. Each graph contains 12 time series, as in Figure 10.5 (see for details). (a) Mean distance 
from the nest, (b) maximum realized foraging range (averaged over the bee community), 
(c) visitation of foraging habitat, and (d) mean trip duration for large bees. Plots (a) and (b) 
start actually at the minimum distance of 5 m (size of one grid cell) indicated with a dashed 
line. The mean foraging distance seems (but is not) higher than the realized foraging range 
in the first few minutes, which is attributable to slightly different assessment methods in the 
model. Plot (d) starts at the “emerged” minimal trip duration. 


habitat did not cover the whole foraging habitat. In a landscape with low foraging 
habitat availability, the bee community reached 8596 within a foraging day, but in a 
landscape with high foraging habitat availability, the bees never covered more than 
40% of the foraging habitat in these simulations. The ranking remained the same for 
all three time-budget scenarios. 


10.4.1.5 Trip Duration 


The mean trip duration increased during the day for all situations (Figure 10.6d), but 
was generally low (below 10 min). Soil-nesting bees had the shortest trips and wood- 
nesting bees had the longest trips, especially those in landscapes with a high foraging 
habitat availability, in agreement with longer foraging distances (Figure 10.6a). The 
ranking of the four responses did not change for the three time-budget scenarios. 
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FIGURE 10.7 Four simulation examples after the initialization phase. The panels represent 
the four combinations of nesting preference and foraging habitat availability from simulation 
experiment 1. These landscape realizations have a certain amount of foraging habitat (darker 
gray areas in a matrix without foraging resources), an intermediate fragmentation level, and 
a population of large bees. A bee's nest is represented as a white dot with a dark border. High 
nest densities appear as merged circles (white stripes with a dark border). (a) Population of 
soil-nesting bees with a low foraging habitat availability. (b) Population of wood-nesting bees 
in a landscape with a low foraging habitat availability. (c) Population of soil-nesting bees in a 
landscape with a high foraging habitat availability. (d) Population of wood-nesting bees in a 
landscape with a high foraging habitat availability. 


10.4.1.6 Time Budget Scenarios 


The three different time-budget scenarios for flytime and time at the nest had only 
quantitative effects (with the number of flowers visited by large bees as the only 
exception) and did not change the relative difference between the different bee types 
in different landscapes. Hence, we consider it acceptable to use a single time-budget 
scenario for systematic investigation of other parameters. Further, we found clear 
differences for bees of different size and for soil-nesting and wood-nesting bees, 
which are worth exploring in detail. 


10.4.1.7 How Well Does the Model Represent Foraging 
Solitary Bees in Real Systems? 

We used the results (mean values at the end of a foraging day, Figures 10.5 and 10.6) 
from this first simulation experiment (with uncalibrated, but realistic parameter 
input) to compare with data from real systems. We collected data from the literature 
with a focus on pollen-collecting solitary bees for several response variables: brood 
cells per day, foraging trip duration, flowers visited (per day and per trip), mean for- 
aging distance from the nest, and far foraging distances within a day (Section 10.3.3). 
We present here an overview of the value ranges (grouped for small, midsize, and 
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large bees as solution for the sparsely available data) and compare them with the 
ranges from the simulations (Table 10.8). 

The model reproduced values quite similar to those of natural systems with over- 
lapping ranges in the majority of the cases (Table 10.8). For all responses, the direc- 
tion of change between small and large bees was correct, and also the intervals 
between the three bee sizes were similar between modeled values and real values. 
However, there were also differences. The modeled bees built more brood cells per 
day than in natural systems, had shorter foraging trips, and flew shorter distances. 
These responses were related to each other in the time series (Section 10.4.4.1). The 
number of flower visits in the model overlapped well with literature values for inter- 
mediate-sized bees, but not so well for small and large bees. The literature data 
for flower visits was sparse and lacked specification of whether or not unsuccessful 
flower visits were included (they were included in the model), which could explain 
the underestimation. 

The modeled response variables yielded realistic values for small, intermediate- 
sized, and large bees, and the modeled ranges generally overlapped well with real 
systems. The model bees were however more efficient than in most natural systems. 
A (too) high number of brood cells may have arisen from less realistic model assump- 
tions such as the exclusion of nectar-foraging trips. Also collecting mud and other 
nest material can take considerable time [140] that is not available for collecting pol- 
len. Some solitary bees only build one cell per day regardless of pollen availability 
and remaining time [91] and are rather egg-limited [152]. Other assumptions were 
that bees collect pollen for 1 brood cell within 10 foraging trips (used to define the 
loading capacity per trip), and bees always had a full load when they return (except 
when flying too far), which is often not the case [153]. In the model, bees always chose 
the most efficient place to nest: near foraging resources, either in the soil between the 
vegetation or at the border of the field. In agricultural landscapes, where much of the 
data originates from, distances between nest and foraging resources may be larger. 
Hence, it makes sense that the data shows less efficient bee performance as well. 

We think that the model yields realistic output and that the overlap with literature 
data is satisfactory, also considering the fact that we used detailed, literature-based 
input values without fitting any parameter. This simulation experiment has also 
shown that the model shows realistic patterns in time. For example, an increasing 
foraging trip duration during the day is a well-known time effect for pollen-foraging 
bees that face local pollen depletion [88,140,141]. 


10.4.2 WHAT Do Extreme PARAMETER VALUES IMPLY FOR 
SourrARY Bees? A GLOBAL SENSITIVITY ANALYSIS 


The goal of this second simulation experiment is to quantify parameter effects 
within their estimated biological range (Section 10.3.1) and to identify the most 
important ones. We analyzed the relative effect on brood cells for 15 parameters 
(flower density [fd], landscape quality for bees [bdc], pollen per flower [ppf], scal- 
ing parameter for perception distance [sightm], scaling parameter for length of 
flight units [flightm], flight path tortuosity [CRW], flower memory [fmem], habitat 
cell memory [cmem], time at the nest [ntime], and landscape stochastic factor [seed] 
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and included the focal parameters body length [size], nesting preference [nest], for- 
aging habitat availability [am], and fragmentation [fr]). We used two values for 
each parameter representing the biological range (Section 10.3.1). The values for 
flower density, pollen per flower, and landscape quality for bees were restricted by 
simulation resources (parameter combinations that resulted in several millions of 
bees required too long running times) and not simulated for the most extreme values, 
but the chosen values cover an acceptable extent of biological range (Table 10.7 and 
Section 10.3.1). We generated a set of parameters for each possible combination (2^ 
combinations) and selected 2,000 of these sets randomly for simulation. We repeated 
the analysis for a longer foraging time (flytime). We present here the most important 
parameter effects and parameter interactions based on linear models for the different 
response variables. 


10.4.2.1 Brood Cells 


The number of brood cells was most affected by the pollen per flower, time at the 
nest, and landscape quality for bees. More total pollen (pollen per flower) and more 
pollen available per bee (landscape quality for bees) resulted in more brood cells. A 
longer time at the nest reduced the time available for collecting pollen and reduced 
the number of brood cells. Several interactions between parameters were important: 
a longer time at the nest reduced the effect of pollen per flower, a high amount of 
pollen per flower reduced the effect of body size to almost none, and a long time at 
the nest as well as a low amount of pollen per flower reduced the effect of bee density 
(landscape quality for bees) to almost none. For a longer foraging time (flytime), the 
order of importance of the discussed parameters and interactions did not change. In 
exceptional cases (in 5 of the 2,000 simulations), the landscape got depleted for long 
foraging times, and in these cases, bees built the amount of brood cells as given by 
bdc (but not exceeding this value). 


10.4.2.2 Flowers Visited 


The number of visited flowers per bee was affected by body length, time at the 
nest, and pollen per flower. Larger bees visited more flowers, and flower visitation 
was also higher for a high amount of pollen per flower. A longer time at the nest 
decreased the number of flower visits. However, parameter interactions could change 
the effect. For a short time at the nest, more pollen per flower resulted in more flower 
visits, while for a long time at the nest more pollen per flower resulted in fewer flower 
visits. The aggregated number of flower visits was not separated for visits of full and 
empty flowers, which probably could explain some of the patterns. Visits of empty 
flowers must have increased for situations with increased competition pressure (such 
as an increased number of bees by a high amount of pollen per flower or more forag- 
ing activity by a short time at the nest). A longer foraging period did not change the 
importance order of the parameters. 


10.4.2.3 Foraging Habitat Visitation 

Foraging habitat visitation of the bee community was most affected by pollen per 
flower, nesting preference, landscape quality for bees, and flower density. Foraging 
habitat visitation (percentage of the foraging habitat visited) was higher for a higher 
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amount of pollen per flower (also more bees flying around) and for soil-nesting bees 
(better distribution over the vegetation). A low bee density (high landscape quality 
for bees) decreases foraging habitat. Foraging habitat visitation by soil-nesting bees 
was hardly affected by foraging habitat availability, while wood-nesting bees had a 
lower foraging habitat visitation for a higher foraging habitat availability (parameter 
interaction). Apparently, wood-nesting bees in field edges were not able to cover the 
complete foraging habitat when there was much of it. For a longer foraging period, 
the effect of foraging habitat availability got more importance, and flower density 
lost importance. Both increase the amount of pollen and the number of bees in the 
landscape. 


10.4.2.4 Mean Distance Flown 


The mean distance flown from the nest per bee was most affected by nesting pref- 
erence, body length, foraging habitat availability, time at the nest, and landscape 
quality for bees. Large wood-nesting bees in landscapes with a high foraging habitat 
availability flew the farthest. A high bee density (low landscape quality for bees) 
and a short time at the nest increased the mean distance flown from the nest. The 
effect of foraging habitat availability was low for soil-nesting bees but strong for 
wood-nesting bees. This parameter interaction was similar to that for foraging habi- 
tat visitation. The importance of parameters for a longer foraging period did switch 
for pairs with very similar importance (nest—size and bdc—ntime). 


10.4.2.5 Conclusions from the Second Simulation Experiment 

The analysis showed that pollen per flower (ppf) had a disproportionate effect on the 
number of brood cells and interacted with body length (size). This could mean that 
small bees perform better on small flowers and large bees on very large flowers. 
However, the other performance responses did not show a strong interaction between 
ppf and size. The time at the nest (ntime) and landscape quality for bees (bdc) had 
predictable effects on the number of brood cells and showed no important interac- 
tions with other parameters. The other response variables were also affected by ppf, 
as well as by size, nest, ntime, bdc, fd, and am. 


10.4.3 WuicH Bopy-Size-RELATED TRAITS AFFECT 
FORAGING BEHAVIOR Most STRONGLY? 


The effect of biologically plausible parameter ranges does not give information 
about parameter effects close to the chosen common values. We therefore investi- 
gate the effect of small standardized changes in model parameters in this and the 
next simulation experiment. In this experiment, we investigate parameters related 
to flight and decision behavior of the bee and those related to the body size of the 
bee (vhi, vmed, ht, r50, sightm, flightm, CRW, pcap, cmem, ig, fmem, 1 plt, u_plt). 
We varied each parameter by +10%. For parameters that normally range between 1 
and 0, we used 0.1% increments instead of 10%. We shifted for CRW and u_pit the 
default value by —0.1 (technical restriction). For general return distance (r50), we 
shifted the probability curve to the left or to the right (moving both Km and shift by 
1096 of r50) after Km and shift were calculated. Since most of the bee parameters are 
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calculated from body length in different steps, we first calculated the default value 
and then applied the deviation (none, —10%, or +10%) randomly. Note that in case 
of ig, sightm, and flightm, there were more than three levels due to dependencies 
with other parameters, leading to multiple applied deviations. We generated 1,000 
unique parameter sets as an alternative for generating all possible combinations. We 
considered wood-nesting bees of intermediate size. We repeated the analysis for soil- 
nesting bees (altered nesting preference, 1,000 new parameter settings) and a longer 
foraging period (flytime 8 h, initial 1,000 sets). 

The analysis proceeded in two steps. (1) We determined which parameters were 
most important for variation in brood cells using a multiple regression model and 
checked for interactions between parameters. We simplified the linear model by 
minimizing the Bayesian Information Criterion (BIC). (2) We calculated the arc 
elasticity of the input parameters, that is, the percentage change in the response 
variable divided over the percentage change in input variable, measured against the 
average of two subsequent levels. A parameter was deemed elastic when the arc 
elasticity was larger than one [154, pp. 72-80]. Conversely, we considered the model 
parameters robust when all elasticity values remained under one. We corrected for 
nonsimulated parameter combinations (far more than the 1,000 simulated combina- 
tions) by predicting the response variable with the regression model. We give here an 
overview of the relevant effects. 


10.4.3.1 Importance of the Bee's Behavioral Traits in Different Situations 


The regression analysis revealed different patterns for three scenarios (wood-nesting 
bee, soil-nesting bee, and an elongated foraging time) in response to 10% change. 
Handling time per flower caused the most variation in the number of brood cells and 
the number of flowers visited under all three scenarios. Handling time per flower 
may also have prevented time being available for other activities as time at the nest 
did in simulation experiment 1. For habitat visitation and distance flown, there were 
differences between bee types. Foraging habitat visitation was most affected by 
length of flight units and the mean distance flown by perception distance for wood- 
nesting bees. For soil-nesting bees, both responses were most affected by the two 
patch-leaving thresholds (/. pit, u. pit). Expansion over the landscape was apparently 
not governed by the same processes as the number of brood cells. There was no 
effect of a longer foraging period on any of the important predictors. Parameter 
interactions had a negligible effect, which means that the parameters in this experi- 
ment acted additively. 


10.4.3.2 Parameter Robustness of the Bee's Behavioral Traits 


Elasticity values were in general low («0.5) across the response variables (Table 10.9), 
which means that they were quite robust against small changes in bee-related parame- 
ters. The parameters causing most variance for each of the response variables were also 
causing the highest sensitivity in response (elasticity value 20.5), but never exceeded 
one. The highest values were for handling time per flower (both for wood- and soil- 
nesting bees), and the model can be considered moderately robust against this param- 
eter. A longer foraging period did slightly decrease elasticity values. Habitat visitation 
was most robust against changes in bee-related parameters (all values below 0.5). 
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10.4.4 How Mucu Do LaANpDscAPE- RELATED 
PARAMETERS AFFECT SOLITARY BEES? 


In this simulation experiment, we investigated the effect of small standardized 
changes in model parameters that altered the landscape and the vegetation (am, fr, 
esize, seed, bdc, fd, ppf, plimit). We followed the same protocol as for the sensitivity 
of bee parameters in simulation experiment 3. 


10.4.4.1 Importance of Landscape Characteristics 

The pollen per flower and pollen availability negatively affected the number of brood 
cells across all three scenarios (wood-nesting bee, soil-nesting bee, and a longer for- 
aging time). Both parameters described the local vegetation properties (as well as 
flower density and foraging habitat availability, which only had a low impact). The 
other three response variables (number of flowers visited, foraging habitat visitation, 
and the mean distance flown) were affected by the same dominant parameter(s), 
which however differed for both bee types. For wood-nesting bees, foraging habi- 
tat availability and landscape stochastic factor were most important (for all three 
responses and for a longer foraging period). These landscape level parameters deter- 
mined the spatial distribution of foraging and nesting resources. An increase in for- 
aging habitat availability resulted in more flowers visited, a lower percentage of 
foraging habitat visited, and longer distances flown. For soil-nesting bees, the land- 
scape quality for bees was important, which determined the landscape-level bee 
density. None of the parameter interactions had an important effect compared to the 
main effects. 

Some of the effects seem contradictory. An increase in local resource availability 
(plimit, ppf) decreased the number of brood cells. An increase in foraging habitat 
availability increased the distance flown, but decreased the percentage of the forag- 
ing habitat visited. We suspect that local bee density around the nest (Figure 10.7) is 
important for these patterns and may be affected by different parameters for both bee 
types (wood-nesting bees responded most to bdc) and should be considered in future 
analyses. The landscape stochastic factor, used for adding spatial structure in the 
landscape generation process, had a stronger effect than landscape fragmentation 
and landscape element size. 


10.4.4.2 Parameter Robustness of Landscape Characteristics 
Elasticity for landscape parameters was also, in general, low («0.5) across the 
response variables, which means that they were quite robust against small changes 
in landscape-related parameters. The parameters causing most variance for each of 
the response variables were also causing the highest sensitivity in response, but val- 
ues never exceeded one. Other high values were for pollen per flower and pollen 
availability (both for wood- and soil-nesting bees), and the model can be considered 
moderately robust against these parameters. A longer foraging period did slightly 
decrease elasticity values. The total number of flowers visited per bee was most 
robust against changes in landscape-related parameters. 

An exception was the very high elasticity of landscape stochastic factor, exceed- 
ing one. We used the set 90—100—110 for this analysis, but the set 99—100—101 would 


258 In Silico Bees 


lead to the same response (due to the stochastic effect of this parameter) and would 
reduce the elasticity values by a factor of 10 (due to 1% change instead of 10% in the 
independent variable). The comparison of the landscape stochastic factor with other 
parameters in this way appears not to be meaningful. However, it does imply that the 
required number of replicates for robust results still needs to be tested. 


10.5 UNDERSTANDING HOW SOLITARY BEES 
INTERACT WITH THE LANDSCAPE 


10.5.1 GENERAL CONCLUSIONS 


The model produced realistic output, but our simplifications led to more efficient 
foraging bees that do not spend time on additional activities or unexpected condi- 
tions existing in the real world. The model seems to be driven by local bee densities 
(affected by vegetation parameters), time budgets (affected by performance limita- 
tions and size of the bee), and the spatial distribution of pollen and nest locations, 
which affected the response variables differently. The model seems to be suitable 
to explore further ecological questions dealing with pollen-collecting solitary bees. 

Different species of solitary bees clearly responded differently to landscape fea- 
tures. It was a remarkable result that wood-nesting bees that nest in field edges per- 
formed worse when there were more foraging resources. Wood-nesting bees needed 
to fly farther from the nest and were therefore under certain conditions more time 
limited than other bees and built fewer brood cells. Body size also had a large impact 
on performance (brood cells, flowers visited, foraging distance), but bees of different 
size did in general respond qualitatively similar to other parameter changes. From 
all size-related traits, handling time per flower has had the most effect on the bee’s 
performance. The amount of pollen per flower and landscape quality for bees had a 
very strong effect as well, by affecting the number of bees in the landscape. Despite 
strong and some unexpected effects in the model, all parameters were robust against 
small changes. 

The simulation experiments showed that the selection of values for some param- 
eters deserves more attention for selection than others. The most uncertain and 
unknown parameters (sightm, flightm, CRW, fmem, cmem) did not have strong 
effects on the response variables and do not require further study. The strong effect 
of pollen per flower (ppf) suggests that the model is suitable for comparing differ- 
ent vegetation types such as fields of clover (little pollen) and fields of sunflowers 
(very much pollen). However, the model does require very long running times for 
large flowers (resources for millions of bees), making such comparisons unattractive. 
Alternatively, one can also consider meadow-like vegetation with moderately sized 
flowers (moderate pollen production) as a legitimate and realistic scenario for future 
simulations, since large flowers are not common in most landscapes. The time-bud- 
get parameters time at the nest and foraging time (flytime) affected the responses, 
but they did not affect the relative impact of other parameters. We suggest a moder- 
ate value for time at the nest, since it is biologically more plausible. A value of 4 h as 
foraging time is just as suitable as 8 h to measure performance within a foraging day 
and saves simulation time. We also consider the selected value for bdc (landscape 
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quality for bees) as biologically more plausible than its extremes (see Section 10.3.1). 
The other important parameters body length, nesting preference, and foraging habi- 
tat availability should be incorporated in all future simulation experiments. 


10.5.2 GENERAL INTEREST AND LIMITATIONS 


The main strength of the model is its high level of realism. In such a mechanistic 
model, all essential processes are controllable with parameters, which enables inves- 
tigation of each parameter independently. This can be especially valuable in ecology, 
since it can rule out variance present in field experiments. In ecological field experi- 
ments, it is often impossible to regulate all environmental conditions independently. 
All of the parameters can potentially be measured, and none of the parameters has 
an abstract meaning, which make the model suitable for many applications. The 
main response simulated (brood cells) is also very direct. It registers the direct per- 
formance of the bee in amount of pollen that can be collected in a certain amount of 
time, which is a relative novel approach for the ecology of bees. Most studies at the 
landscape scale deal with aggregated responses such as species numbers and indi- 
vidual numbers, while the model can study the potential offspring (brood cells) for a 
certain bee species in a certain landscape. 

We experienced also some limitations. The many parameters in the model intro- 
duce uncertainty. We have put substantial effort in reducing these parameter uncer- 
tainties by extensive literature review (Section 10.3.1), effect exploration (simulation 
experiment 1), and sensitivity analysis (simulation experiments 2, 3, and 4), but this 
did not inform us about all uncertainties. We did, for example, test what the conse- 
quences would be if each of the bee traits would be 10% higher or lower than that 
estimated by the scaling relationship (simulation experiment 3), but we did not test 
what consequences altered scaling relations would have (possibly leading to larger 
deviations than 10% for small or large bees). In addition to this, we ignored that some 
parameters could scale with body size as well (but have not been shown yet to do so 
for bees or similar insects), such as for time at the nest, the perceived grain size, and 
the preference for a certain flower size (pollen per flower). The model design not only 
involved assumptions based on observations, but some were also made for simplify- 
ing reasons. The model assumed that small and large bees use the same proportion 
of their flower visiting time for pollen collection, that male and female cells are built 
in equal ratio (mean number of trips required per cell was applied as fixed value), 
and that bees choose to nest near their foraging resource. These simplifications may 
have caused that the model bees were more efficient than real bees (Section 10.4.1.2). 

Ideally, we would like to validate the model for fixed positions in the parameter 
space, but the field data only allowed us to show that their ranges overlap well with 
the model’s response variables. The response variable “brood cells” (per individual, 
per day) is difficult to link to field studies since most studies give the number of 
brood cells per trap nest (undefined number of individuals) or per lifetime (undefined 
number of days). Further, most experimental studies have measured only a fraction 
of the parameters used as input for the model, and up to now there was no complete 
set of environmental parameters available for the model. This is another clear disad- 
vantage of a large number of parameters. Some of the important parameters such as 
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flower density and activity time of the bee could be measured, but no single study at 
the landscape level did so far. Other parameters, such as the local bee density in the 
environment or the amount of pollen per flower, may be hard to measure accurately 
in the field. A suggestion is to roughly estimate the parameters for field studies to get 
a complete set of parameters. Landscape parameters can be assessed from land-use 
maps validated by field surveys and be completed with estimated flower densities for 
each land-use class. A more difficult-to-measure parameter such as pollen produc- 
tion per flower could be approximated by flower size. The bee's body length can 
be measured in the field as well and serve as proxy for behavioral foraging traits. 
Measuring such values in the field and using them as input for the model to simulate 
specific situations have a high potential for understanding observed field patterns. 

In general, more field research would benefit the model. Fundamental and descrip- 
tive ecological research could strengthen theoretical relationships between body size 
and traits that affect time budgets. Measurement efforts to assess or at least estimate 
the complete set of parameters for several example landscapes would strengthen 
further model validation. However, due to the labor-intensive nature of parameter 
assessment in the field, such measurements are restricted by financial resources. This 
financial issue would favor applying the model in its current state, since it is quite 
elaborate already. In the case of future application of the model, it is important to 
ask whether it is acceptable that the model simulates more efficient bees than in real 
systems (e.g., by nesting close to their foraging resource) and whether it is of minor 
importance for the specific research question. 


10.5.3 Ourtook 


We found several interesting results that are worth exploring further, mainly con- 
cerning bee type and landscape structure. Soil-nesting and wood-nesting bees 
responded differently to landscape structure, and body size also affected perfor- 
mance. Species differ, and systematic simulations could help to find out how their 
performance differs in different landscapes and what the causes are. Both the spatial 
resource distribution of pollen and nest locations influence how bees behave in the 
model, and they determine depletion patterns. How does fragmentation of the spatial 
patch mosaic influence the interaction between bees and their performance? How 
do bee size, nesting preference, and landscape structure affect pollination services? 

Finally, the model has the potential to study other topics and learn more about 
bee biology. What is, for example, the effect of different foraging trade-offs? How 
do handling time, pollen requirements, number of flower visits, and patch-size selec- 
tion affect one another? Are there optimal strategies concerning different "giving 
up times" at the flower and the patch level? Can bees of different size optimize their 
foraging behavior by choosing an optimal flower size? 
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ABSTRACT 


Vespa velutina nigrithorax, an Asian bee-hawking hornet, was unintentionally intro- 
duced in southwestern France before 2004 and is currently spreading widely across 
the country. By modeling the climatic suitability of the yellow-legged hornet at a 
global scale using various niche models, we estimated the potential invasion risk of 
this invasive species across the world, with a focus on Europe. We used eight dif- 
ferent modeling techniques within an ensemble forecast framework to show that the 
invasion success in southwestern France could have been predicted using data from 
the native Asian range of the species. We further used data from both the native and 
invaded ranges (including a recently established population in Korea) to better pre- 
dict the potential invasion range across all continents. Results are discussed in terms 
of the interest of ecological niche modeling for invasion biology, realized niche of 
the invasive wasp, potential threats to native entomofauna, and economic impacts of 
this new predator. Particular attention is paid to beekeeping activities that are nowa- 
days already threatened by a wide panel of adversary factors. However, as far as we 
know, the true impact of the alien hornet on colony losses and on honey production 
has not yet been evaluated in France or in its area of origin. Regions at risk hold 
the highest densities of beehives in Europe, which could suffer from the potential 
predation of the putative invading hornet of both honey bees and wild pollinators. 
Furthermore, the impacts of V. velutina on pollinators must be quickly investigated, 
as they might well have more durable consequences than the already publicly known 
nuisance to apiculture. 


KEYWORDS 


Beekeeping, Invasive species, Native range, Niche modeling, Social Hymenoptera, 
Vespidae 


11.1 INTRODUCTION 


Honey bees are essential pollinators of crops [1,2]. In Europe, important pollinator 
declines have been reported, which jeopardize pollination services in agricultural 
ecosystems and have great economic impacts [3—6]. The recent accidental introduc- 
tion of the yellow-legged Asian bee-hawking hornet, Vespa velutina, into Burope 
represents a new threat to beekeeping activities. The hornet was unintentionally intro- 
duced in southwestern France before 2004 and since then has rapidly spread, cover- 
ing about half of the country by 2011. Its arrival in northern Spain was also reported 
in 2010 and in Portugal and Belgium in 2011 [7-9]. Being a bee-hawking preda- 
tor, this species has been noticed by the French population since 2007. Considered 
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as a dangerous stinging insect and a major threat to domestic bees, its expansion 
could challenge the economic viability of beekeeping and affect pollination services. 
Therefore, modeling the potential invasion extent of the invasive hornet appeared 
necessary to predict regions at risk and, hence, to help with planning future surveys 
of invasion range expansion and possible dedicated protection measures. The inva- 
sion progression currently observed matched with the predictions assessed using cli- 
matic suitability models [9]. We detail here the history of invasion and the biological 
cycle of the invasive wasp, its realized niche, and its potential range expansion in the 
world. We discuss the potential economic impacts of this new predator to beekeep- 
ing activities, which are nowadays already threatened by a wide panel of adversary 
factors [4,5,10—15]. 


11.2 HISTORY AND ORIGIN OF THE INVASION 


The establishment of Vespa velutina in France represents the first successful inva- 
sion of an exotic social wasp into Europe [16]. Twenty other species have been intro- 
duced in various countries around the world, 12 of which were established in the 
Americas [17]. The potential for vespid wasps to gain assisted passage from humans 
is high as fertilized queens of many species seek sheltered locations to undergo dia- 
pause. Such shelters are often found in human goods, which may then be transported 
to new locations all around the world [17]. 

The yellow-legged hornet was recorded for the first time in Aquitaine in 2005 
[18] but locally collected data suggested that hibernating founder queens could have 
been imported from China before 2004 through the horticultural trade [19]. This 
hornet has also established itself in Korea in the 2000s, where its spread remains 
very limited [20,21] compared to France. A key difference, however, is that Korea 
has six other hornet species that may compete with the alien species, whereas France 
has only one, the native European hornet Vespa crabro [9]. Moreover, one of the 
Korean hornets (V. mandarinia) is not only a fierce predator of social wasps and bees 
but also the most dominant when competing for food with other hornet species [22]. 
Vespa crabro is larger but has less populous colonies than Vespa velutina, and its 
nesting sites are different. While it has a similar prey spectrum, it does not mainly 
focus its attacks on social Hymenoptera as Vespa velutina does [23,24] and is con- 
sidered in Europe as a mild predator of honey bees [25]. 

Asiais the center of evolutionary diversification of hornets [22]; 20 of the 22 known 
Vespa species are naturally restricted to Asia and Oceania and two others expanded 
westwards: the Oriental hornet Vespa orientalis reached the Mediterranean basin, 
where it is also known as a fear predator of honey bees [26.27], while the European 
hornet occupied the whole of Eurasia. So far, Vespa crabro is the only hornet species 
acclimatized in the United States after it was released in the nineteenth century to 
control forest caterpillar outbreaks [28]. Since then, it does not seem to have caused 
any particular damage [17]. 

Vespa velutina, which comprises 12 color variants in its natural area of distribu- 
tion, is distributed from north Afghanistan to Bhutan, eastern China, Indochina, 
and Indonesia [29,30]. The French invasive lineage that belongs, as the Korean 
ones [20], to the black brown variant nigrithorax (Figure 11.1a), is restricted to 
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(b) 


FIGURE 11.1 (See color insert.) (a) Adult worker and nest of Vespa velutina nigrithorax. 
(b) Heat-balling behavior of Apis cerana on Vespa velutina auraria (Nepal). 
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the temperate parts of this area: from West Bengal (India) and Bhutan to north- 
eastern China [19]. Molecular comparisons between native and invasive popula- 
tions of Vespa velutina are in course to test the hypotheses of a Chinese origin and 
of the potential pathway modalities of its introduction in France. The analysis of 
the microsatellite allelic frequencies has evidenced a strong consanguinity among 
the invasive population, which may indicate a single introduction of one or more 
queens [31]. 


11.3 LIFE CYCLE 


Apart from reported damages on hives, little was known about Vespa velutina in its 
native range [32-34]. Studies performed since 2007 in France greatly improved the 
knowledge on the biology of this species [7,9,24,35,36]. Like many social wasps, 
Vespa velutina produces annual colonies, initiated by a single queen. Each fertil- 
ized foundress builds a primary nest in spring (February-April), earlier than that of 
Vespa crabro (April-May). She takes care of its brood until the first batch of adult 
Workers emerges and takes over the work of enlarging the nest and feeding larvae, 
leaving the queen to focus on egg-laying activity. Thus, the colony initiated by a 
single individual develops by producing up to 15,000 individuals through the season 
(from April to November). In autumn, a nest may include up to 2,000 workers that 
rear more than 1,000 future queens and drones. The sexual offspring leave the nest 
in late autumn, generally after the death of the mother queen, and take part in mating 
flights. After reproductive swarming, the colony, composed only of remaining work- 
ers, males, and brood, decline to finally pass on before midwinter. Thus, a colony 
never survives more than 1 year, and the only survivors are the future foundresses 
that seek winter shelters to hibernate. This efficient life cycle initiated by only one 
individual makes social insects, such as hornets, redoubtable invaders [17]. 

The primary nest is generally founded in a sheltered place (hive, hut, hole in a 
wall, roof edge, bramble, etc.); however, as for many other hornet species [22], when 
the environment becomes adverse or the primary site too narrow for the growing 
nest, the colony relocates after building a secondary nest in a more open and higher 
location—mainly tree tops [9,36]. Initially spheroid, the nest often becomes ovoid at 
the end of the season, reaching on average 40—60 cm in diameter, while the largest 
nests may attain about 1 m in height and 80 cm in diameter. Vespa velutina nests are 
easy to distinguish from nests of all other European social wasps by their narrow 
entrance always open at the lateral side of the envelope (Figure 11.1). After the death 
of the colony in winter, the empty nest may remain more or less undamaged in place 
during several weeks or months. 


11.4 PREDATION BEHAVIOR 


Like other hornet species, Vespa velutina is a generalist predator that attacks a wide 
range of arthropod preys. It may also tear out flesh pellets from vertebrate dead 
bodies, as well as from fish and shrimp in open markets [9,36]. The hornet generally 
attacks its prey in flight and immediately hangs on to a support, keeps the prey’s 
thorax, which contains the nutritious flight muscles, and discards the rest. The flesh 
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pellet is then brought to the nest to feed larvae with proteins, while adults only 
consume sweet liquids and an energetic protein-rich liquid regurgitated by larvae 
[22]. Workers transport sweet liquids (sap exuding from trunks, honeydew, nectar, 
flesh of ripe fruit, etc.) in their crop to feed their fellows remaining in the nest by 
trophallaxis, including the queen and future foundresses. 


11.4.1 Prey SPECTRUM 


Observations made in French agricultural and natural areas showed that honey bees 
and social wasps may represent more than two-thirds of the preys captured by a 
colony, while flies (mainly hover flies, flesh and carrion flies) account for most of the 
rest of its diet. Other arthropods only represent a small fraction of preys, but they 
contrariwise belong to a wide variety of insects and spiders [35,36]. Our observa- 
tions in Asian countries where the yellow-legged hornet is common showed that this 
predator focuses its attacks on feeding sources that provide insects more or less con- 
tinuously along the day, like beehives and yellow jacket nests, carcasses and herds 
flown by flies, or honey flowers sought by pollinators [37]. In France, for example, 
umbels are such honey flowers that provide, in large number, pollinator preys (nota- 
bly hover flies) to hornets. The predation impact of Vespa velutina on local entomo- 
fauna rapidly increases during summer with the size of the colony, and it reaches its 
maximum in October when workers feed the sexual brood [38]. The invasive hornet 
impact on the diversity and biomass of the invertebrate fauna in the invaded region 
is still under study [38]. 


11.4.2 PREDATION ON Honey BEES 


In the French territory, Vespa velutina multiplication was likely favored by the 
dense and wide occurrence of the European honey bee, which is one of its main 
preys. However, while it represents generally more than 70% of its diet in urbanized 
areas with poorly diversified entomofauna, it is much less captured (about 30%) 
in agricultural or natural and forestry sites where many other preys are available 
[24,35,36]. 

In Asia, many hornet species hunt honey bees but only several of them focus their 
attacks on hives. Apart from the giant hornet Vespa mandarinia, which attacks hives 
in groups, other species including Vespa velutina are bee-hawking hornets that pre- 
date bees individually, waiting for returning foraging bees in front of hives [22] or 
catching them when foraging in the field [39]. Vespa velutina is considered as a fierce 
enemy of honey bee colonies in Kashmir, India, Nepal [40], and China [41], as well 
as in Korea [21], countries where several other hornet species may hover at the same 
time in front of hives. Nevertheless, no real quantification of the impact of these hor- 
nets is available in the literature. Ken et al. [42] reported that 20%-30% of a colony 
of the Eastern honey bee Apis cerana might succumb to the predation of Vespa velu- 
tina in China, while losses appeared even greater for introduced European honey 
bees. In the presence of bee-hawking hornets, the cessation of forager activity and 
the consecutive stop of honey storage in the beehive are the main factors that impact 
the winter survival of honey bee colonies [43]. 
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11.4.3 Honey Bee DEFENSE STRATEGY 


Having faced their hornet predators for long, native Asian honey bees have devel- 
oped efficient strategies to defend their colonies. For example, when attacked by 
Vespa mandarinia or the yellow hornet Vespa simillima, the Eastern bee Apis cer- 
ana and the dwarf bee Apis florea form a ball of workers around the intruder and 
kill it by heat stroke [41,44] (Figure 11.1b). Similarly, Apis mellifera cypria in Cyprus 
forms a ball to kill the Oriental hornet, although the underlying killing mechanism 
(asphyxia) is different [26]. Observations made in the field in France showed that 
Apis mellifera mellifera is able to withstand the attack of this new predator [27,43]. 
However, several decades after its introduction in Asia, the European honey bee 
became able to display the same balling and killing behavior as Apis cerana although 
with less efficiency [41,45]. 


11.5 CURRENT INVASION RANGE EXPANSION 


Figure 11.2 shows the invasion progress of the alien hornet from 2004 to 2011. Since 
2006, the monitoring of Vespa velutina presence in France is made by individual 
public warning through an online biodiversity database held by the MNHN [46]. 
The web page dedicated to Vespa velutina provides general information on the inva- 
sive hornet and the species with which it can be confused. Articles, fact sheets, and 
a slideshow are also downloadable [46]. Even if data are incomplete, notably for 


FIGURE 11.2 (See color insert.) Annual distribution of Vespa velutina in Europe. 
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the first 2 years of observation (in addition to the still uncompleted 2010 and 2011 
recordings), it is clear that the yellow-legged hornet rapidly spread out during this 
short period with a range expansion at around 100 km per year [7]. A few nests have 
also been recorded more than 200 km away from the invasion front [7], suggesting 
accidental human transport or migration of foundresses as reported for Vespa crabro 
by Mulhauser and Vernier [47]. First experiments showed that Vespa velutina found- 
resses can fly about 30 km in one day [36]. 

The first two nests were reported by a bonsai producer in Lot-et-Garonne 
(southwestern French counties) in 2004 [19]. Then the number of recorded nests 
gradually increased to reach 1,637 in 32 counties in 2009 [7,9]. The precise number 
of nests recorded in 2010 and 2011 is still unknown due to ongoing verification pro- 
cesses of public observations. In fact, misidentifications of adults and nests, mainly 
with representatives of other vespid species, lead to almost 3096 of wrong records. 
The potential extent map obtained from modeling (see thereafter) would have been 
strongly overvalued with these incorrect records [35]. 

Nevertheless in 2011, already acquired records showed that the presence of 
the yellow-legged hornet already covered 50 French counties, corresponding to 
270,000 km? of invaded area [8]. Moreover, the invasive hornet has now reached 
neighboring countries: Spain in 2010 [48,49] and Portugal and Belgium in 2011 
[8,50]. 

The habitat of more than 4,000 nests correctly georeferenced between 2007 and 
2009 was determined from the CORINE Land Cover database [51]. A nest distribu- 
tion analysis showed that about 4996 were located in urban or periurban areas, 4396 
in farmlands, 7% in woodlands, and 1% in wetlands. However, we must also consider 
that public warning is not homogeneous and that record frequency also depends on 
the opening of the environment, the nests being more likely visible and easily located 
in urbanized and open territories than in forests and closed nonurbanized environ- 
ments [35,36]. 


11.6 INVASION RISK MODELING 


Impacts on domestic bees and native insect communities could locally challenge 
beekeeping economics and affect pollination services. Thus, modeling the potential 
invasion extent of the yellow-legged hornet around the world appeared necessary to 
predict regions at risk and, hence, to help with planning future surveys of potentially 
invaded areas and possible dedicated control measures, a prerequisite for replacing 
the reactive nature of current solutions with a proactive, predictive approach. 


11.6.1 Monts 


To predict the potential invasion risk by Vespa velutina, we used ecological niche 
modeling to infer suitable distribution ranges. Combining presence data of the taxon 
and bioclimatic variables allows modeling the species niche, while further project- 
ing this niche geographically provides worldwide predictions of distribution suit- 
ability. For introduced invasive species, the presence data should include locations 
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from both native and invaded ranges, and niche modeling tools are best multiplied 
than combined in an ensemble forecast framework. We used eight climatic variables 
for the niche modeling, extracted from the BIOCLIM database as five arc-minute 
grids (http://www.worldclim.org/ [52]). We considered the annual mean temperature, 
the temperature seasonality, the maximum temperature of the warmest month, the 
minimum temperature of the coldest month, the annual precipitation, the precipita- 
tion of the wettest month, the precipitation of the driest month, and the precipitation 
seasonality (coefficient of variation). Climatic variables are supposed to be the main 
contributors to species niche delimitation at large scales [53], and these variables 
have previously been used for insect niche modeling [54]. Temperature and precipita- 
tion seasonality are computed as the standard deviations of the monthly values. The 
use of climatic variables only assumes that current range limits are mainly driven by 
climate, which is a reasonable assumption at such a continental scale. 

Climatic suitability was modeled by running eight different niche-based model- 
ing techniques using the BIOMOD platform [55]. These models are (1) generalized 
linear model (GLM); (2) generalized additive model (GAM); (3) classification tree 
analysis (CTA), a classification method running a 50-fold cross-validation to select 
the best trade-off between the number of leaves of the tree and the explained devi- 
ance; (4) artificial neural networks (ANNs), a machine learning method, with the 
mean of three runs used to provide predictions and projections, as each simulation 
gives slightly different results; (5) multivariate adaptive regression splines (MARS); 
(6) mixture discriminant analysis (MDA), a classification method that uses MARS 
function for the regression part of the model; (7) generalized boosting model (GBM), 
a machine learning method that combines a boosting algorithm and a regression tree 
algorithm to construct an "ensemble" of trees; and (8) random forest (RF), a machine 
learning method that is a combination of tree predictors such that each tree depends 
on the values of a random vector sampled independently and with the same distribu- 
tion for all trees in the forest. In order to evaluate the predictive performance of a 
species distribution model, we used a random subset of 7096 of the data to calibrate 
every model and the remaining 30% for the evaluation. Models were evaluated using 
a receiver operating characteristic (ROC) curve and the area under the curve (AUC; 
[56]). We replicated the data splitting five times and calculated the average AUC of 
the cross-validations, which gives a more robust estimate of the predictive perfor- 
mance of each model. The final calibration of every model for making predictions 
uses 100% of the data available. 

Presence data concerned only the variant Vespa velutina nigrithorax, with the 
French and Korean localities considered as nonnative. Two biases occurred in the 
presence data and necessitated a dedicated treatment: (1) records from the invaded 
range were by far more numerous (n^ 1,700) than records from the native range 
(n2 69) and (2) the species range is still expanding in France, with more presence 
records close to the introduction center; so we randomly draw two localities per 
administrative county to avoid potential overweighting of historical invaded sites. 
At the time of the modeling exercise (end of 2010), the hornet occurred in 39 French 
counties and the random selection of at most 2 records per county resulted in a sub- 
set of 69 records—the same sample size as available for the native range. The final 
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consensus map obtained from the models included outputs from 10 random subsets 
of invaded locations. 


11.6.2 POTENTIAL RANGE EXPANSION 


The consensus map obtained from the models showed that Vespa velutina nigri- 
thorax could successfully invade many other parts of the world since the scenario 
of introduction through international trade that occurred in France could well be 
repeated [9]. 

Results emphasized that the area of invasion is globally discriminated from most 
of the Asian area of origin by its higher levels of precipitations during the driest 
month of the year—this represents an extension of the realized niche of the native 
grounds. Many countries of Western Europe exhibited a high probability of being 
invaded with a higher risk along the Atlantic and northern Mediterranean coasts. 
Coastal areas of the Balkan Peninsula, Turkey, and Near East also appeared suit- 
able and could potentially be colonized later. All these European areas could well 
be reached by the still expanding French introduced population. Reduced invasion 
risks only concern dryer European southern regions (Figure 11.3). If accidentally 
introduced, the invasive hornet could also acclimatize in many other parts of the 
world (Figure 11.4), notably regions already invaded by Vespula germanica, with 
which it shares a similar climatic niche [9]. This yellow jacket is widely distributed 
in Eurasia and was (as the European Vespula vulgaris) unintentionally but success- 
fully introduced in many regions of the world during the past decades; as well as 
being widespread, these two wasps have become significant pests in most countries 
they have invaded [17]. 


FIGURE 11.3 (See color insert.) Predicted potential invasion risk of V. v. nigrithorax in 
Europe, based on ensemble forecast models using eight climatic data from WorldClim. The 
suitability probability is increasing from dark blue to red. (From Villemant, C. et al., Biol. 
Conserv., 144, 2142, 2011.) 
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FIGURE 11.4 (See color insert.) Predicted potential invasion risk of V. v. nigrithorax in 
the world, based on ensemble forecast models using eight climatic data from WorldClim. The 
suitability probability is increasing from dark blue to red. (From Villemant, C. et al., Biol. 
Conserv., 144, 2142, 2011.) 


11.6.3 INVASION Risks AND BEEKEEPING ACTIVITY IN EUROPE 


When comparing the map of invasion risks (Figure 11.3) with the density of man- 
aged honey bee colonies in Europe and Turkey (Figure 11.5a [57,58]), we can notice 
that many European countries, and notably the Balkan area, combine a high level 
of beekeeping activity with a high risk of Vespa velutina acclimatization. Though 
ranking fourth in Europe with more than one million registered hives [59], France 
does not show as a whole a high level of beehive density due to the extent of its 
agricultural lands. However, when considering the previous ratio at the regional 
level (Figure 11.5b [59,60]), it appears that—in addition to the whole southwest of 
France—the Rhone valley, Corsica, and Alsace gather the greatest managed beehive 
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FIGURE 11.5 Ratio between the number of registered (or estimated) managed hives and 
the surface of agricultural land (beehive number per 10 km?) in (a) Europe and Turkey and 
(b) the French regions. Data (2007 for land surface, 2008 for beehives) from FAO agricultural 
resources [59]. For countries from which official data are lacking in FAOSTAT, estimated 
data are from the Apiservices database [60]. Beehive numbers in France (2004) are from the 
Gem-Oniflhor (2005) report [58] and land surface data from the 2000's French agricultural 
survey [57]. 
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numbers with the highest risks of Vespa velutina arrival. Moreover in Spain, which 
counts the greatest number of beehives (more than 2.5 million in 2008) in Europe, 
recently underwent the arrival of the bee-hawking hornet in the Basque country, 
colonizing from the French invasive population. In 2011, the invasive hornet also 
reached the north of Portugal. In our models, both Basque country and northern 
Portugal faced a high risk of invasion. On the other hand, the potential expansion of 
Vespa velutina could be constrained by the presence of a congeneric competitor [61] 
in countries like Albania, Greece, and Turkey, where it would face Vespa orientalis, 
another active bee-hawking hornet [26,27]. Indeed, it seems that the success of the 
invasion in France, explained by the ongoing colonization of new realized climatic 
niches, might well have been favored by a release from congeneric competition [62]. 


11.7 POTENTIAL CONSEQUENCES OF THE INVASION 


Due to the size and the increasing number of its colonies, as well as the duration of 
its period of activity, the yellow-legged hornet is able to remove a considerable bio- 
mass of arthropods, so that vulnerable prey species may become threatened [36], as 
observed in southern countries invaded by European yellow jackets. In New Zealand, 
for example, the amount of preys killed by Vespula vulgaris and V. germanica has 
been considered to be similar to that consumed by the entire local insectivorous 
bird fauna [63]. However, while consuming a large variety of preys, the ecological 
and economic consequences of the spread of the invasive hornet would be particu- 
larly strong through its impact on honey bees and other pollinators. Such a potential 
impact must however be carefully assessed by comparison of faunas of the same 
areas before and after invasion [64]. Being able to predict the risk of acclimatization 
of Vespa velutina in a given region will thus greatly help with planning where to 
survey prey populations in a before/after invasion design in order to provide insights 
into a wide variety of impacts associated with such invasions. 


11.7.1 IMPACT ON BEEKEEPING 


For several decades, American and European managed honey bees have been in 
decline, though information for Europe remains patchy and localized [3,5,11]. In 
France, colony numbers are greater today when compared to 1961 populations, but 
have constantly decreased after reaching a peak in 2000 [65]. A wide panel of adver- 
sary factors, such as pests and diseases, pesticides, and loss of forage or beekeeping 
practices, are involved in this phenomenon throughout Europe [4,12—15]. The invasion 
of the yellow-legged hornet adds to this long list a new protagonist that will undoubt- 
edly focus its attack on weakened bee colonies. Its damages on honey bee colonies 
are well established in the native range [39,45] and could be amplified in the invaded 
ranges. Even if the predation pressure may not be detrimental, at least bee behavior 
is modified; attacked hives spend more resources to face hornet attacks than to store 
reserves and produce honey. This could challenge the survival of the hive, especially 
during the winter, but also (as a direct or indirect consequence) the activity of honey 
production itself. Beekeepers could abandon this activity if their hives do not pro- 
duce enough honey to ensure reasonable incomes. This would represent a direct loss 
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in free pollination services provided by the honey producers. This loss in services is 
associated with an economic cost, which can be estimated as the costs of funding the 
maintenance of the hives or of artificially pollinating crops. However, as far as we 
know, the true impact of the alien hornet on colony losses and honey production has 
not yet been evaluated in France or in its area of origin. 


11.7.2 THREAT TO LOCAL ENTOMOFAUNA 


If actively preyed, locally rare species may be endangered by the presence of the 
invasive hornet. Ongoing studies on the species prey spectrum comprise barcode 
referencing of the preys [38]. Indeed, visually determining the preys is very often 
challenging, as only insect thorax pieces are brought back to the nest. Consequently, 
barcoding is of great interest as a tool for better describing the prey spectrum. In 
addition, comparing these results to barcoded reference collections will allow an 
easy detection of rare or endangered species preyed by Vespa velutina. 

In Europe, populations of social wasps should notably be impacted by Vespa 
velutina, as yellow jackets may represent a third of its prey spectrum. Moreover, 
the European hornet, whose colonies are three times smaller than those of Vespa 
velutina [66], may be threatened when competing for food with the huge colonies of 
its invasive congener. Further studies, however, are required to assess the prey over- 
lap between the two species [36]. 

On the other hand, thoughtless reactions of the French public facing Vespa 
velutina invasion appeared to be more deleterious to the entomofauna than the pest 
problem itself. Uncontrolled mass trappings performed every year in France, in and 
outside the invaded area, by beekeepers and general public kill a huge number of 
nontarget insects [67,68], while uncontrolled nest destructions have a side effect by 
their greater impact on social vespid populations than in the past. 


11.7.3 THREAT TO POLLINATION SERVICES 


Pollinators play a key role in most wild plant communities and agroecosystems 
[2,5,11,69]. A recent review by Potts et al. [6] reminds us that the value of insect polli- 
nation to European agriculture is estimated to be worth ~€22 billion per year [2] with 
84% of European crop varieties being dependent, at least in part, on insect pollina- 
tors [70]; wildflowers being also highly dependent on insects for their reproduction, 
with an estimated 78%-—94% of flowering species relying on biotic pollination [71]. 
Furthermore, the persistence of a plant community can be affected by a loss of diver- 
sity of its pollinating fauna. Thus, the functional diversity of plant-pollinator networks 
may be critical for the functioning of ecosystems and should be carefully protected 
[72,73]. By predating various taxonomic groups of pollinators, such as Apidae and 
Syrphidae especially, Vespa velutina is already interfering with native plant-pollina- 
tor networks. These impacts must soon be investigated, as they might well have more 
durable consequences than the already publicly known consequences on apiculture. 

Furthermore, hoverflies are not only efficient pollinators but many of them are 
also natural predators of aphids in their larval state and thus play an important role 
in reducing these agricultural pests [74]. 
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11.7.4 Impact ON HUMANS 


Bees and social wasps have a well-known and painful sting that can occasionally 
cause a life-threatening allergic reaction, but death from such envenomation remains 
arare event. Multiple stings that generally result from an accidental nest disturbance 
are even rare. Moreover, with supportive care, most nonallergic victims should be 
able to survive attacks from hundreds of wasps [75]. In France, there is concern from 
the general public when the enormous nests of Vespa velutina are discovered after 
leaf fall, often hanging from tree crowns at tens of meters above the ground [7]. As 
the species is common in urbanized areas, there is potential for an increase in the 
likelihood of humans being stung and a consequent increasing risk of allergic reac- 
tions [36]. However, the high location of most of the nests limits the risk of colony 
disturbance, and so far the rate of Hymenoptera stings appears not to have increased 
in regions colonized by the yellow-legged hornet [76]. 


11.8 CONTROL 


When they happen to shelter in goods that get shipped, hibernating wasp found- 
resses have indeed a relatively low probability of being detected with standard pro- 
tocols used for custom inspection [77]. On the other hand, as quoted by Thomas 
[78] for invasive yellow jackets in New Zealand, mass destruction of hornet founder 
queens in spring seems to have virtually no effect on nest density in the following 
summer months [17,36,63,78,79], while side effects on nontarget species may be 
important [68]. The best control measure is to kill off a colony by spraying per- 
methrin inside the nest after dark, when foraging activities cease. The nest is then 
removed and burned. However, nests are often difficult to locate before leaf fall, 
when sexual progeny is already produced [36]. While it is impossible to stop or slow 
the natural spread of the invasive hornet, the unique possibility is to use specific 
baited mass traps to protect hives from very fierce hornet attacks. The development 
of such specific traps is still under investigation [80], while it is too late now to con- 
sider any efficient global eradication methods for this bee-hawking hornet. Efforts 
have now to be made to slow down the range expansion and to mitigate the impacts 
on domestic and wild pollinators, with priorities defined from the modeled invasion 
risk across Europe. 


11.9 CONCLUSION 


Social wasps represent a particularly destructive and successful group of invasive 
invertebrates. Their sociality, including a number of unique mechanisms enhancing 
survival and reproduction, is certainly the key factor that substantially contributes 
to their success as invaders [81]. Their main general advantage may be the flex- 
ibility arising from having both individual and colony responses. This confers upon 
them a remarkable efficiency to compete and exploit food sources, buffering against 
environmental changes. They develop populous colonies with an effective predator 
defense and produce numerous foundresses that provide large dispersal capacity 
[81,82]. 
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Given the potential economic and biological impacts of the invasive yellow-legged 
hornet, ongoing developments are focusing on better understanding the invasion 
dynamics by developing modeling approaches to predict the rate of range expansion, 
which is necessary for a temporal risk assessment and the further implementation of 
effective management strategies [83,84]. 

Furthermore, it would be of great interest to investigate the perturbations 
Vespa velutina might engender to the complete pollinator community. Theoretical 
approaches could be used, modeling theoretical mutualistic networks of plants and 
pollinators and applying an orientated change in the structure of the plant-pollinator 
network (mimicking depredation by the hornet on some of the pollinator agents). 
Results would help to understand how these changes might modify stability proper- 
ties and architecture of the whole mutualistic network. 
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